-- Logs begin at Tue 2022-09-13 02:40:44 UTC, end at Tue 2022-09-13 03:42:30 UTC. -- Sep 13 03:12:20.296330 dv-cinder-857075-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 03:12:20.305392 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 03:12:20.308121 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 03:12:20 2022] *** Sep 13 03:12:20.308121 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 03:12:20.308121 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 03:12:20.308121 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: nodename: dv-cinder-857075-2-iscsi Sep 13 03:12:20.308121 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: machine: x86_64 Sep 13 03:12:20.308121 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: clock source: unix Sep 13 03:12:20.308121 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: pcre jit disabled Sep 13 03:12:20.308121 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: detected number of CPU cores: 4 Sep 13 03:12:20.308121 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: current working directory: / Sep 13 03:12:20.308121 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: detected binary path: /usr/bin/uwsgi-core Sep 13 03:12:20.308789 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: your processes number limit is 47680 Sep 13 03:12:20.308789 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: your memory page size is 4096 bytes Sep 13 03:12:20.308789 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: detected max file descriptor number: 2048 Sep 13 03:12:20.308789 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: lock engine: pthread robust mutexes Sep 13 03:12:20.308789 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: thunder lock: enabled Sep 13 03:12:20.308789 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 03:12:20.308789 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 03:12:20.347537 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: Python main interpreter initialized at 0x5593d5e299c0 Sep 13 03:12:20.347537 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: python threads support enabled Sep 13 03:12:20.347537 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: your server socket listen backlog is limited to 100 connections Sep 13 03:12:20.347537 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: your mercy for graceful operations on workers is 90 seconds Sep 13 03:12:20.347830 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 03:12:20.347900 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: *** Operational MODE: preforking *** Sep 13 03:12:20.348145 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: *** uWSGI is running in multiple interpreter mode *** Sep 13 03:12:20.348145 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: spawned uWSGI master process (pid: 105408) Sep 13 03:12:20.348330 dv-cinder-857075-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 03:12:20.352107 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: spawned uWSGI worker 1 (pid: 105409, cores: 1) Sep 13 03:12:20.352107 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: spawned uWSGI worker 2 (pid: 105410, cores: 1) Sep 13 03:12:20.352107 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 03:12:21.008401 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 03:12:21.026485 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 03:12:22.096029 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 03:12:22.096029 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: from cryptography.utils import int_from_bytes Sep 13 03:12:22.096514 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 03:12:22.096514 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: from cryptography.utils import int_from_bytes Sep 13 03:12:22.103220 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 03:12:22.103220 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: from cryptography.utils import int_from_bytes Sep 13 03:12:22.103637 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 03:12:22.103637 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: from cryptography.utils import int_from_bytes Sep 13 03:12:24.605154 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 03:12:24.605717 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 03:12:24.605924 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 03:12:24.606277 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 03:12:24.606531 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 03:12:24.606950 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.607276 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.607598 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.607921 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.608249 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.608438 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 03:12:24.608802 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.608892 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 03:12:24.608969 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.609173 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.609275 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 03:12:24.609498 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.609592 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 03:12:24.609758 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.609848 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 03:12:24.610074 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.610171 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.610399 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857075-2-iscsi {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.610497 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.610744 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.610851 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.611053 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.611155 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.611364 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.611458 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.611681 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.611773 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.611984 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.612073 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.612294 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.612387 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.612598 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.612690 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.612858 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.613092 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.613206 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.613476 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857075-2-iscsi {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.613640 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.613792 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.613917 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.614098 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.614228 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.614399 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.614521 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.614737 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.614870 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.615037 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.615176 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.615353 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.615488 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.615668 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.615803 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.615990 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.616161 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.616309 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.616467 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.616676 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857075-2-iscsi {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.616804 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.616999 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.617137 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.617312 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.617440 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.617626 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.617760 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.617958 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.618093 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.618275 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.618402 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.618580 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.618729 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.618915 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.619057 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.619227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.619904 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.620128 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.620237 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857075-2-iscsi {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.620449 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.620544 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.620758 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.620855 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.621082 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.621188 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.621385 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.621481 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.621690 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.621785 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.621999 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.622088 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.622306 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.622406 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.622645 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.622803 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.622950 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.623085 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.623246 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.623402 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.623531 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.623655 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.623824 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.623955 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.624087 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.624305 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.624436 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.624570 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.624722 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.624858 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.624989 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.625123 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.625247 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.625378 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.625510 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.625635 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.625791 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.625920 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.626100 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.626234 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.626407 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.626533 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.626738 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.626875 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.627051 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.627184 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.627358 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.627502 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.627642 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.627767 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.627889 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.628011 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.628144 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.628277 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.628432 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.628560 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.628735 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.628867 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.629036 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.629172 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.629322 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.629454 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.629623 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.629751 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.629927 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.630132 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.630260 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.630382 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.630504 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.630698 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.630841 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.631037 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.631164 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.631355 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.631483 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.631664 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.631806 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.631982 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.632116 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.632301 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.632433 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.632608 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.632742 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.632915 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.633041 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.633213 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.633338 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.633530 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.633668 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.633839 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.633973 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.634133 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.634283 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.634483 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.634641 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.634768 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.634907 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.635034 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.635168 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.635306 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.635431 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.635615 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.635753 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.635922 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.636057 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.636225 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.636354 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.636582 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.636718 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.636842 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.636972 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.637108 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.637234 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.637369 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.637503 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.637637 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.637771 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.637934 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.638071 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.638235 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.638364 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.638535 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.638729 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.638857 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.638981 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.639143 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.639282 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.639442 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.639591 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.639742 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.639881 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.640049 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.640179 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.640349 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.640489 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.640647 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.640783 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.640944 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.641073 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.641245 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.641388 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.641527 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.641660 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.641826 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.641954 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.642138 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.642277 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.642453 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.642596 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.642778 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.642907 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.643077 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.643208 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.643376 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.643515 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.643676 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.643804 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.643967 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.644106 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.644273 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.644402 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.644604 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.644738 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.644873 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.644999 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.645159 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.645288 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.645456 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.645583 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.645757 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.645888 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.646053 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.646180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.646351 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.646489 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.646721 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.646850 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.646975 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.647109 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.647243 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.647377 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.647542 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.647678 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.647840 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.647969 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.648134 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.648278 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.648431 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.648567 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.648728 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.648864 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.649022 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.649159 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.649318 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.649453 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.649612 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.649742 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.649913 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.650053 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.650205 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.650340 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.650516 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.650865 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.650994 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.651128 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.651254 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.651384 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.651511 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.651635 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.651774 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.651906 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.652038 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:12:24.652204 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.652354 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.652518 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.652684 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.652854 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.653023 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.653151 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.653336 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.653465 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.653662 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.653802 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.653978 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.654121 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.654290 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.654430 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.654669 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.654808 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.654934 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.655059 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.655229 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.655386 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.655525 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.655652 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.655829 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.655977 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.656135 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.656264 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.656449 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.656582 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.656761 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.656903 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.657088 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.657230 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.657402 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.657531 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.657715 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.657851 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.658029 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.658166 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.658336 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.658465 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.658676 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.658795 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.659002 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.659129 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.659327 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.659447 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.659646 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.659742 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.659973 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.660092 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.660307 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.660403 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.660615 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.660712 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.660932 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.661029 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.661247 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.661346 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.661556 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.661651 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.661864 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.661961 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.662175 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.662280 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.662486 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.662582 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.662828 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.662927 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.663137 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.663273 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.663454 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.663584 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.663764 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.663894 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.664068 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.664195 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.664382 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.664518 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.664691 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.664895 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.665024 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.665147 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.665293 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.665432 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.665600 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.665728 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.665909 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.666036 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.666770 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.666917 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.667082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.667218 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.667390 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.667519 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.667696 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.667832 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.668000 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.668127 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.668320 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.668456 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.668648 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.668785 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.668956 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.669085 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.669256 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.669392 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.669596 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.669726 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.669865 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.669989 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.670144 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.670273 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.670445 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.670594 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.670784 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.670927 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.671102 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.671229 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.671403 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.671531 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.671708 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.671835 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.672022 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.672148 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.672328 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.672457 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.672635 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.672771 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.672939 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.673075 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.673241 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.673369 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.673547 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.673674 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.673851 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.673987 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.674157 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.674285 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.674456 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.674590 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.674785 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.674941 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.675133 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.675263 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.675387 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.675513 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.675678 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.675817 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.675983 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.676118 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.676292 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.676421 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.676843 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.676978 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.677158 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.677287 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.677467 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.677597 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.677773 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.677903 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.678092 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.678221 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.678400 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.678535 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.678727 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.678857 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.679030 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.679157 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.679339 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.679468 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.679645 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.679774 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.679955 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.680091 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.680260 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.680401 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.680569 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.680697 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.680856 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.680985 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.681159 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.681302 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.681459 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.681587 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.681758 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.682489 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.682647 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.682793 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.682927 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.683054 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.683216 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.683352 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.683518 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.683666 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.683820 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.683949 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.684120 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.684289 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.684424 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.684550 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.684720 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.684850 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.685025 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.685173 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.685378 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.685507 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.685631 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.685755 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.685879 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.686029 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.686212 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.686343 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.686512 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.686660 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.686871 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.686999 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.687201 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.687331 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.687516 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.687645 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.687833 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.687979 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.688143 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.688273 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.688455 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.688589 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.688763 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.688904 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.689069 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.689376 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.689505 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.689707 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.689844 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.689992 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.690121 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.690298 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.690425 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.690629 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.690775 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.690939 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.691067 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.691258 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.691387 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.691565 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.691697 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.691880 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.692008 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.692179 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.692314 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.692490 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.692619 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.692802 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.692937 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.693112 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.693240 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.693430 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.693559 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.693737 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.693865 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.694041 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.694168 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.694335 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.694462 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.694667 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.694799 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.694975 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.695103 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.695281 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.695485 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.695623 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.695749 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.695874 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.696013 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.696175 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.696303 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.696488 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.696616 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.696793 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.696935 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.697108 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.697243 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.697428 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.697571 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.697762 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.697902 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.698062 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.698192 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.698395 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.698567 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.698747 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.698958 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.699113 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.699244 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.699404 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.699534 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.699711 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.699841 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.700033 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.700160 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.700340 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.700478 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.700645 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.700775 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.700953 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.701086 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.701255 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.701383 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.701555 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.701693 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.701860 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.701989 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.702169 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.702297 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.702476 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.702605 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.702805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.702934 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.703106 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.703253 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.703417 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.703546 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.703724 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.703853 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.704024 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.704163 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.704358 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.704500 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.704633 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.704766 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.704932 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.705070 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.705238 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.705366 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.705560 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.705688 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.705881 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.705993 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.706184 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.706312 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.706489 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.706595 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.706830 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.706942 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.707138 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.707227 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.707439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.707527 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.707741 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.707830 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.708042 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.708130 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.708380 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.708469 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.708690 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.708786 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.708990 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.709087 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.709300 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.709389 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.709615 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.709705 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.709926 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.710021 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.710237 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.710333 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.710540 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.710651 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.710870 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.710970 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.711186 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.711287 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.711496 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.711583 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.711797 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.711884 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.712103 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.712203 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.712406 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.712493 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.712709 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.712803 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.713013 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.713307 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.713399 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.713643 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.713800 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.713942 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.714083 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.714243 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.714383 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.714574 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.714749 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.714915 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.715066 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.715207 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.715359 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.715571 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.715807 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.715954 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.716095 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.716258 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.716424 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.716570 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.716718 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.716859 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.717007 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.717166 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.717316 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.717467 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.717616 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.717765 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.717905 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.718045 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.718212 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.718353 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.718493 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.718667 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.718816 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.718957 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.719109 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.719251 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.719392 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.719532 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.719672 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.719818 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.719968 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.720135 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.720280 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.720428 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.720569 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.720709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.720858 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.721023 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.721169 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.721310 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.721456 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.721605 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.721746 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.721895 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.722053 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.722194 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.722334 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.722552 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.722720 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.722862 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.723003 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.723153 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.723293 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.723442 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.723583 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.723723 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.723879 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.724032 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.724174 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.724323 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.724463 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.724646 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.724787 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.724928 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.725077 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.725225 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.725365 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.725505 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.725645 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.725813 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.726042 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.726042 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.726322 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.726322 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.726631 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.726788 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.726938 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.727078 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.727226 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.727366 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.727505 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.727664 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.727805 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.727953 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.728094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.728241 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.728389 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.728537 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.729187 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.729342 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.729490 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.729630 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.729769 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.729917 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.730068 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.730221 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.730370 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.730510 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.730687 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.730843 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.730984 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.731124 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.731263 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.731404 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.731552 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.731692 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.731831 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.731980 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.732120 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.732266 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.732415 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.732557 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.732696 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.732835 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.732974 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.733112 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.733260 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.733400 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.733548 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.733688 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.733836 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.733985 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.734137 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.734278 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.734417 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.734557 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.734768 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.734926 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.735066 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.735206 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.735345 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.735485 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.735632 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.735791 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.735932 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.736157 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.736303 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.736455 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.736596 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.736750 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.736890 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.737038 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.737178 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.737319 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.737458 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.737626 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.737776 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.737917 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.738056 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.738196 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.738344 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.738485 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.738674 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.738822 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.738962 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.739101 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.739261 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.739404 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.739554 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.739695 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.739835 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.739975 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.740134 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.740279 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.740420 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.740560 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.740560 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.740825 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.740972 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.741112 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.741259 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.741413 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.741561 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.741710 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.741850 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.741998 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.742139 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.742278 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.742417 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.742565 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.742737 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.742878 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.743019 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.743158 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.743313 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.743461 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.743601 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.743740 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.743886 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.744034 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.744181 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.744382 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.745044 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.745184 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.745323 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.745557 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.745868 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.746202 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.746482 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.746812 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.747139 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.747405 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.747565 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.747742 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.747889 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.748067 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.748221 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.748370 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.748518 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.748691 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.748855 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.748996 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.749136 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.749275 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.749425 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.749590 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.749736 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.749898 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.750045 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.750209 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.750365 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.750506 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.750676 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.750823 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.750963 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.751131 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.751281 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.751422 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.751561 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.751731 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.751878 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.752092 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.752233 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.752380 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.752527 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.752678 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.752818 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.752971 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.753119 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.753260 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.753399 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.753538 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.753678 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.753825 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.753989 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.754136 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.754298 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.754452 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.754652 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.754801 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.754941 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.755121 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.755265 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.755405 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.755559 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.755701 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.755841 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.756015 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.756162 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.756385 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.756541 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.756694 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.756834 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.756974 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.757143 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.757283 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.757432 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.757573 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.757713 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.757852 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.757991 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.758145 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.758286 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.758435 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.758574 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.758752 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.758893 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.759044 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.759192 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.759386 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.759532 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.759712 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.759859 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.760040 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.760182 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.760344 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.760509 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.760658 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.760797 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.760949 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.761097 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.761247 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.761388 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.761528 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.761677 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.761818 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.761957 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.762097 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.762236 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.762448 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.762602 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.762818 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.762975 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.763118 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.763257 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.763420 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.763581 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.763722 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.763862 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.764012 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.764178 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.764335 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.764485 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.764626 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.764803 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.764950 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.765139 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.765298 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.765438 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.765579 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.765742 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.765889 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.766030 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.766177 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.766327 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.766671 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.766671 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.766958 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.767099 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.767247 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.767388 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.767536 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.767683 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.767824 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.767965 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.768113 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.768254 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.768414 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.768555 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.768694 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.768841 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.768988 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.769128 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.769277 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.769527 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.769674 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.769815 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.769953 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.770107 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.770259 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.770426 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.770580 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.770777 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.770930 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.771079 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.771220 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.771370 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.771511 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.771651 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.771790 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.771962 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.772119 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.772277 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.772419 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.772559 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.772697 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.772882 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.773028 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.773195 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.773344 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.773509 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.773664 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.773812 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.773954 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.774116 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.774273 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.774414 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.774563 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.774760 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.774917 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.775070 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.775175 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.775385 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.775486 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.775710 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.775811 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.776010 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.776102 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.776330 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.776428 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.776631 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.776721 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.776941 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.777097 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.777252 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.777393 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.777534 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.777681 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.777821 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.777961 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.778109 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.778260 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.778408 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.778548 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.778746 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.778888 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.779044 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.779185 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.779325 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.779472 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.779613 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.779761 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.779911 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.780062 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.780203 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.780342 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.780515 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.780706 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.780859 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.781001 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.781140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.781279 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.781425 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.781575 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.781715 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.781863 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.782015 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.782162 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.782303 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.782452 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.782592 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.782766 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.782918 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.783059 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.783230 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.783389 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.783531 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.783671 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.783856 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.784015 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.784165 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.784305 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.784481 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.784637 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.784778 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.784926 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.785081 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.785229 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.785417 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.785570 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.785716 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.785880 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.786038 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.786185 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.786331 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.786477 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.786663 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.786883 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.787054 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.787202 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.787349 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.787502 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.787650 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.787805 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.787970 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.788119 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.788266 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.788412 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.788565 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.788729 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.788878 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.789025 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.789172 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.789318 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.789473 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.789629 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.789777 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.789933 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.790088 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.790245 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.790392 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.790639 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.790806 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.790954 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.791100 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.791781 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.791937 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.792093 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.792241 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.792387 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.792545 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.792698 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.792855 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.792855 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.793134 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.793283 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.793438 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.793586 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.793744 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.793893 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.794039 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.794192 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.794357 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.794515 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.794710 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.794864 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.795011 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.795157 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.795303 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.795505 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.795665 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.795814 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.795960 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.796107 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.796253 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.796253 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.796553 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.796708 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.796935 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.796935 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.797219 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.797375 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.797523 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.797671 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.797817 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.797964 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.798120 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.798285 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.798433 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.798581 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.798772 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.798929 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.799085 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.799244 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.799399 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.799548 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.799695 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.799854 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.800001 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.800164 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.800312 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.800459 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.800606 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.800765 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.800920 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.801074 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.801222 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.801369 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.801515 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.801956 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.802106 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.802265 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.802411 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.802558 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.802748 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.802898 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.803058 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.803206 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.803367 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.803518 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.803674 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.803830 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.803983 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.804142 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.804297 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.804453 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.804600 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.804747 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.804894 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.805052 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.805199 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.805354 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.805354 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.805689 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.805845 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.806004 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.806150 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.806342 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.806492 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.806691 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.807380 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.807533 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.807692 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.807853 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.808002 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.808148 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.808301 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.808448 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.808614 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.808769 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.808916 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.809063 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.809063 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.809346 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.809502 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.809657 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.809804 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.810014 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.810162 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.810309 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.810474 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.810644 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.810798 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.810946 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.811093 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.811241 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.811399 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.811547 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.811547 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.811823 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.811984 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.812141 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.812296 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.812454 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.812601 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.812748 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.812894 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.813049 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.813206 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.813361 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.813512 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.813659 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.813805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.813961 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.814109 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.814265 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.814430 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.814577 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.814769 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.814930 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.814930 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.815223 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.815372 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.815518 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.815713 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.815866 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.816013 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.816161 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.816319 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.816489 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.816645 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.816799 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.816946 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.817093 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.817239 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.817385 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.817540 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.817695 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.817848 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.818003 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.818149 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.818317 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.818475 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.818639 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.818792 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.818950 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.819098 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.819260 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.819408 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.819556 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.819703 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.819856 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.820004 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.820223 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.820223 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.820523 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.820523 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.820809 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.820809 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.821096 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.821244 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.821391 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.821750 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.821905 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.822059 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.822216 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.822364 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.822552 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.822756 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.822917 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.823078 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.823234 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.823393 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.823540 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.823689 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.823834 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.823995 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.824150 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.824297 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.824443 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.824600 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.824747 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.824903 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.825056 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.825204 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.825350 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.825502 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.825650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.825848 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.826007 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.826155 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.826155 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.826432 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.826600 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.826775 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.826923 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.827069 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.827226 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.827373 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.827535 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.827683 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.827830 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.827977 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.828130 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.828277 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.828448 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.828595 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.828741 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.828887 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.829036 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.829182 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.829182 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.829470 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.829616 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.829763 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.829908 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.830069 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.830224 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.830385 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.830531 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.830715 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.830864 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.831021 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.831169 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.831315 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.831462 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.831608 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.831755 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.831911 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.832059 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.832217 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.832217 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.832494 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.832649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.832796 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.832942 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.833089 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.833235 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.833393 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.833550 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.833697 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.833851 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.833999 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.834156 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.834303 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.834458 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.834604 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.834795 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.834942 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.835089 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.835248 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.835396 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.835543 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.835689 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.835876 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.836040 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.836196 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.836346 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.836499 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.836647 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.836793 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.836942 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.837097 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.837245 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.837400 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.837548 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.837548 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.837836 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.837995 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.838678 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.838842 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.838990 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.839144 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.839301 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.839450 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.839596 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.839742 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.839897 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.840044 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.840199 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.840358 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.840513 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.840513 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.840792 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.840948 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.841102 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.841249 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.841402 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.841550 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.841697 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.841697 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.841983 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.842139 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.842286 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.842433 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.842581 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.842784 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.842934 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.843081 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.843234 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.843380 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.843535 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.843683 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.843846 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.843846 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.844140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.844293 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.844453 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.844601 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.844748 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.844894 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.845050 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.845196 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.845352 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.845499 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.845646 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.845792 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.845988 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.846141 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.846297 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.846591 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.846828 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.846975 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.847138 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.847293 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.847440 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.847593 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.847741 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.847889 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.848054 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.848201 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.848347 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.848493 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.848493 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.848769 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.848989 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.849138 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.849291 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.849438 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.849584 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.849730 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.849885 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.850044 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.850190 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.850344 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.850490 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.850712 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.850868 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.851015 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.851162 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.851315 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.851462 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.851621 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.851768 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.851914 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.852078 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.852225 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.852371 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.852526 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.852680 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.852835 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.852982 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.853129 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.853282 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.853438 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.853591 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.854292 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.854457 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.854604 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.854792 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.854947 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.855095 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.855283 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.855446 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.855601 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.855757 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.855905 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.856091 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.856244 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.856391 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.856548 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.856704 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.856861 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.857008 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.857162 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.857311 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.857465 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.857622 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.857776 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.857924 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.858070 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.858217 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.858384 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.858532 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.858706 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.858856 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.859002 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.859148 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.859328 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.859523 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.859523 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.859804 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.859951 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.860097 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.860252 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.860411 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.860565 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.860713 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.860860 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.861024 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.861180 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.861326 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.861474 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.861619 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.861773 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.861932 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.862080 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.862237 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.862392 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.862540 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.862738 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.862897 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.863045 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.863192 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.863338 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.863484 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.863640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.863797 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.863945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.864109 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.864257 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.864410 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.864568 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.864716 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.864868 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.865016 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.865162 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.865320 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.865476 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.865632 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.865780 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.865926 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.866132 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.866298 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.866446 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.866593 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 03:12:24.866770 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.866770 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.866770 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.866770 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.867327 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.867327 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:12:24.867327 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 03:12:25.017723 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Registered counter for database nova_api Sep 13 03:12:25.020439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO dbcounter [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Registered counter for database nova_api Sep 13 03:12:25.039922 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:12:25.043594 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_db.sqlalchemy.engines [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:12:25.047123 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:12:25.052311 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writer thread running {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:12:25.105034 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.context [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8232eabc-875a-4f0b-84ce-ecae7315d84c(cell1) {{(pid=105410) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 03:12:25.109029 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:12:25.109454 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:12:25.111029 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:12:25.111134 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.context [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8232eabc-875a-4f0b-84ce-ecae7315d84c(cell1) {{(pid=105409) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 03:12:25.111756 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:12:25.112203 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:12:25.114173 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:12:25.114861 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:12:25.115333 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:12:25.116189 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Registered counter for database nova_cell0 Sep 13 03:12:25.116883 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:12:25.117593 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:12:25.118033 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:12:25.120074 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:12:25.120309 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Registered counter for database nova_cell1 Sep 13 03:12:25.122019 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO dbcounter [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Registered counter for database nova_cell0 Sep 13 03:12:25.125974 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO dbcounter [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Registered counter for database nova_cell1 Sep 13 03:12:25.127835 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:12:25.129558 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:12:25.132789 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_db.sqlalchemy.engines [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:12:25.135958 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:12:25.137381 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_db.sqlalchemy.engines [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:12:25.137497 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:12:25.138009 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writer thread running {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:12:25.277097 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writer thread running {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:12:25.283781 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Registered counter for database nova_cell0 Sep 13 03:12:25.285490 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO dbcounter [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Registered counter for database nova_cell0 Sep 13 03:12:25.290949 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:12:25.294553 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_db.sqlalchemy.engines [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:12:25.295766 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:12:25.299366 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writer thread running {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:12:25.633883 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 03:12:25.636975 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: WARNING keystonemiddleware.auth_token [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 03:12:25.641614 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 03:12:25.644228 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: WARNING keystonemiddleware.auth_token [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 03:12:25.985497 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 03:12:25.987869 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: WARNING keystonemiddleware.auth_token [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 03:12:25.991450 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 03:12:25.993785 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: WARNING keystonemiddleware.auth_token [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 03:12:25.997600 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5593d5e299c0 pid: 105410 (default app) Sep 13 03:12:25.999685 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5593d5e299c0 pid: 105409 (default app) Sep 13 03:12:25.999788 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:12:26.000845 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-65bbb61e-6cd0-412a-846a-ae0970e301a1 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001689 Sep 13 03:12:26.001258 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Tue Sep 13 03:12:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:13:46.950109 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:13:46.952235 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002852 Sep 13 03:13:46.952627 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:13:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:13:46.968494 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=3 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:46.969629 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell1:SELECT=3 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:46.970791 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell0:SELECT=3 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:46.971761 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:47.852141 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-93770527-f713-4617-a84a-6261c8b35f0e admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:13:47.884724 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-93770527-f713-4617-a84a-6261c8b35f0e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925725 Sep 13 03:13:47.885519 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Sep 13 03:13:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:13:50.487873 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:13:50.488880 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-ff50515a-7a0d-4dd9-b5ef-84718e2e4375 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Sep 13 03:13:50.490254 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 2/4] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:13:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:13:50.930223 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-a71e0b2e-998f-4c19-94d6-f15aadc550f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:13:50.978093 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-a71e0b2e-998f-4c19-94d6-f15aadc550f1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.482495 Sep 13 03:13:50.978676 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 3/5] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 03:13:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 03:13:50.993448 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_api:SELECT=3 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:50.994360 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_cell0:SELECT=3 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:50.995457 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_cell1:SELECT=3 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:50.996548 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:51.202590 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-5b777bbf-e355-4355-bacd-b098209c3d37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:13:51.269925 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-5b777bbf-e355-4355-bacd-b098209c3d37 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282994 Sep 13 03:13:51.270516 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 3/6] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 13 03:13:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:13:53.876816 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-a71e0b2e-998f-4c19-94d6-f15aadc550f1 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:13:53.877941 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-a71e0b2e-998f-4c19-94d6-f15aadc550f1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 13 03:13:53.878431 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 4/7] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:13:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:13:54.538576 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-486822a9-2296-470a-b256-edaffc7c728b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "name": "ds512M", "id": "d1"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:13:54.580390 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-486822a9-2296-470a-b256-edaffc7c728b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.695142 Sep 13 03:13:54.581201 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 4/8] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 03:13:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 03:13:54.593505 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-adefb28b-9a66-46d5-8a19-dd9f3db552be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:13:54.632668 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-adefb28b-9a66-46d5-8a19-dd9f3db552be admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042652 Sep 13 03:13:54.633590 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 5/9] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 13 03:13:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:13:57.287032 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-486822a9-2296-470a-b256-edaffc7c728b admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:13:57.288111 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-486822a9-2296-470a-b256-edaffc7c728b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Sep 13 03:13:57.288515 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:13:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:13:57.703916 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-05343df3-ab39-4859-b83a-c70469cefb9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "disk": 10, "swap": 0, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:13:57.723777 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-05343df3-ab39-4859-b83a-c70469cefb9c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427979 Sep 13 03:13:57.724333 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 6/11] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 03:13:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:13:57.736793 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-ba94bdd2-7ca9-4da3-ab29-3a2e0533d6ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:13:57.767729 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-ba94bdd2-7ca9-4da3-ab29-3a2e0533d6ca admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034741 Sep 13 03:13:57.768316 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 6/12] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 13 03:13:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:14:00.372264 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-05343df3-ab39-4859-b83a-c70469cefb9c admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:00.373181 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-05343df3-ab39-4859-b83a-c70469cefb9c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 13 03:14:00.373576 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 7/13] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:14:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:00.778068 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-0be919ca-9420-47cc-88ff-09baf1d59948 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2, "ram": 2048, "disk": 10}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:00.800600 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-0be919ca-9420-47cc-88ff-09baf1d59948 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.420457 Sep 13 03:14:00.801535 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 7/14] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 03:14:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:14:00.814531 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-76db0cb8-493e-4390-a717-119f264ce4d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:00.844043 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-76db0cb8-493e-4390-a717-119f264ce4d2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033156 Sep 13 03:14:00.844623 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 8/15] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 13 03:14:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:14:03.463544 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-0be919ca-9420-47cc-88ff-09baf1d59948 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:03.464705 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-0be919ca-9420-47cc-88ff-09baf1d59948 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001738 Sep 13 03:14:03.465175 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 8/16] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:14:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:03.874229 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-07cbb561-02a3-4802-b2c5-6f9478aeded6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "name": "ds4G", "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:03.892321 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-07cbb561-02a3-4802-b2c5-6f9478aeded6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.419343 Sep 13 03:14:03.892865 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 9/17] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 03:14:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:14:03.906723 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-c4a3542e-0d51-43c0-83f3-dc5cc222773e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:03.932073 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-c4a3542e-0d51-43c0-83f3-dc5cc222773e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029133 Sep 13 03:14:03.932645 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 9/18] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 13 03:14:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:14:06.511691 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-07cbb561-02a3-4802-b2c5-6f9478aeded6 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:06.512617 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-07cbb561-02a3-4802-b2c5-6f9478aeded6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 13 03:14:06.513017 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 10/19] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:14:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:06.960610 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-7d7125f6-95ef-4164-93c4-97faaf17fa0e admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:06.985686 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-7d7125f6-95ef-4164-93c4-97faaf17fa0e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.466593 Sep 13 03:14:06.986230 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 10/20] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Sep 13 03:14:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:14:09.679864 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-07cbb561-02a3-4802-b2c5-6f9478aeded6 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:09.681445 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-07cbb561-02a3-4802-b2c5-6f9478aeded6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Sep 13 03:14:09.681852 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 11/21] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:14:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:10.097748 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-1a1d456d-0608-4d2e-a462-5f9c4a9f6b01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 512, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:10.118193 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-1a1d456d-0608-4d2e-a462-5f9c4a9f6b01 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.430192 Sep 13 03:14:10.118771 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 11/22] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 03:14:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:14:10.130801 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-145f477e-93cc-4328-a7b2-c1fa1cc98a22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:10.158041 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-145f477e-93cc-4328-a7b2-c1fa1cc98a22 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030873 Sep 13 03:14:10.158639 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 12/23] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 13 03:14:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:14:12.745919 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-1a1d456d-0608-4d2e-a462-5f9c4a9f6b01 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:12.746979 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-1a1d456d-0608-4d2e-a462-5f9c4a9f6b01 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 13 03:14:12.747382 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:14:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:13.168325 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-2bca2707-a057-49ad-adb4-8d092c74e7d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:13.188489 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-2bca2707-a057-49ad-adb4-8d092c74e7d1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.434298 Sep 13 03:14:13.189084 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 13/25] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 03:14:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:14:13.201282 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-1ba43d00-e538-4552-8e79-5c6dc98b2cb1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:13.224272 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-1ba43d00-e538-4552-8e79-5c6dc98b2cb1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026829 Sep 13 03:14:13.224834 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 13/26] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 13 03:14:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:14:15.846909 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-2bca2707-a057-49ad-adb4-8d092c74e7d1 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:15.848507 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-2bca2707-a057-49ad-adb4-8d092c74e7d1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Sep 13 03:14:15.851000 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:14:15 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:16.296751 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-d8f97367-8831-48e6-a6dc-4bef23d5d091 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:16.322119 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-d8f97367-8831-48e6-a6dc-4bef23d5d091 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.466423 Sep 13 03:14:16.323245 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 14/28] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 03:14:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 03:14:16.335071 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-d91f2e27-c960-4a27-969d-5b89a2ea4122 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:16.363738 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-d91f2e27-c960-4a27-969d-5b89a2ea4122 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032387 Sep 13 03:14:16.364923 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 15/29] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 13 03:14:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:14:19.017504 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-d8f97367-8831-48e6-a6dc-4bef23d5d091 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:19.018528 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-d8f97367-8831-48e6-a6dc-4bef23d5d091 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 13 03:14:19.019281 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:14:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:19.464664 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-5df57227-ef04-4c40-9b4d-49ffc4c3861d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "swap": 0, "id": "4"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:19.473577 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:14:19.490358 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-5df57227-ef04-4c40-9b4d-49ffc4c3861d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.464725 Sep 13 03:14:19.491288 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 16/31] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 03:14:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:14:19.502868 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-27f43474-5c89-4598-8fcb-4c6c71054bd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:19.529021 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-27f43474-5c89-4598-8fcb-4c6c71054bd7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029737 Sep 13 03:14:19.529711 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 16/32] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 13 03:14:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:14:22.125963 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-5df57227-ef04-4c40-9b4d-49ffc4c3861d admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:22.126916 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-5df57227-ef04-4c40-9b4d-49ffc4c3861d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 13 03:14:22.127312 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 17/33] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:14:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:22.561565 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-361033da-a616-4e27-a147-dd133e6b10f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:22.569870 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:14:22.587811 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-361033da-a616-4e27-a147-dd133e6b10f0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.454285 Sep 13 03:14:22.588949 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 17/34] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 03:14:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:14:22.600252 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-4a343ea3-8983-41e0-b113-3f9f158f0640 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:22.627637 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-4a343ea3-8983-41e0-b113-3f9f158f0640 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031059 Sep 13 03:14:22.628219 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 18/35] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 13 03:14:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:14:39.843098 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-361033da-a616-4e27-a147-dd133e6b10f0 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:39.844215 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-361033da-a616-4e27-a147-dd133e6b10f0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Sep 13 03:14:39.844611 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 18/36] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:14:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:39.855674 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:14:40.232223 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-7a0c2815-fcd0-427f-adcb-bc60855ca2b6 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:40.250427 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-7a0c2815-fcd0-427f-adcb-bc60855ca2b6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399952 Sep 13 03:14:40.250980 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Sep 13 03:14:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:14:41.542102 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-361033da-a616-4e27-a147-dd133e6b10f0 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:41.542531 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-361033da-a616-4e27-a147-dd133e6b10f0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Sep 13 03:14:41.542954 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 03:14:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:42.063078 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-8211551f-f558-4366-a5fd-0703d81e7ab8 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:42.068394 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.wsgi [None req-8211551f-f558-4366-a5fd-0703d81e7ab8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-8211551f-f558-4366-a5fd-0703d81e7ab8 admin admin] Request method failure captured: Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Accept: application/json Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Accept-Encoding: gzip, deflate Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Connection: keep-alive Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Content-Length: 0 Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Host: 10.222.0.18 Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Openstack-Api-Version: compute 2.92 Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Openstack-System-Scope: None Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: User-Agent: python-novaclient Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Auth-Token: gAAAAABjH_Wh85vHAN_FWtWOtDHBO5r2EA0k68Hl9Drv4mIEraBzOgJu53xSFEiw6bS-Y6KiMDhrjkGnEl-CFhfzxT_Tdpw8bjvUjemyIz83lVwJ8fPgRbCygTUDf8FtHPaZdSbfoWRr8TDzLalPyT2OBl4wnHhEVqEZBpeP3-F5e1zgklrM8uU Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Domain-Id: None Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Domain-Name: None Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Identity-Status: Confirmed Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Is-Admin-Project: True Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Project-Domain-Id: default Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Project-Domain-Name: Default Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Project-Id: 76c5181fc7be45279ac00017bb4640b3 Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Project-Name: admin Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Role: admin,reader,member Sep 13 03:14:42.072375 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Roles: admin,reader,member Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/76c5181fc7be45279ac00017bb4640b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_76c5181fc7be45279ac00017bb4640b3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/76c5181fc7be45279ac00017bb4640b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/76c5181fc7be45279ac00017bb4640b3"}]}] Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Tenant: admin Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Tenant-Id: 76c5181fc7be45279ac00017bb4640b3 Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Tenant-Name: admin Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User: admin Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User-Domain-Id: default Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User-Domain-Name: Default Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User-Id: 49f280ab086b4610855c4ffa378517d9 Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User-Name: admin Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: method: > Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: exception: Flavor 42 could not be found. Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: action_args: {'id': '42'} Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:14:42.074038 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:14:42.075180 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:42.076650 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-8211551f-f558-4366-a5fd-0703d81e7ab8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:14:42.077984 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-8211551f-f558-4366-a5fd-0703d81e7ab8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393541 Sep 13 03:14:42.077984 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Sep 13 03:14:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 03:14:42.083982 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-d76b8d46-8283-414d-99b3-ea76c9928e77 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:42.106185 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-d76b8d46-8283-414d-99b3-ea76c9928e77 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026088 Sep 13 03:14:42.106740 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 13 03:14:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:14:42.117065 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-c2b2fbbe-bd52-4918-b84f-11e581c05367 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:42.139586 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-c2b2fbbe-bd52-4918-b84f-11e581c05367 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026916 Sep 13 03:14:42.140120 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 13 03:14:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:14:42.149732 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-9ebd6e79-2da1-48b8-9b29-350952ef9225 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:42.154925 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.wsgi [None req-9ebd6e79-2da1-48b8-9b29-350952ef9225 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-9ebd6e79-2da1-48b8-9b29-350952ef9225 admin admin] Request method failure captured: Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Accept: application/json Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Accept-Encoding: gzip, deflate Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Connection: keep-alive Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Content-Length: 0 Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Host: 10.222.0.18 Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Openstack-Api-Version: compute 2.92 Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Openstack-System-Scope: None Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: User-Agent: python-novaclient Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Auth-Token: gAAAAABjH_Wh85vHAN_FWtWOtDHBO5r2EA0k68Hl9Drv4mIEraBzOgJu53xSFEiw6bS-Y6KiMDhrjkGnEl-CFhfzxT_Tdpw8bjvUjemyIz83lVwJ8fPgRbCygTUDf8FtHPaZdSbfoWRr8TDzLalPyT2OBl4wnHhEVqEZBpeP3-F5e1zgklrM8uU Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Domain-Id: None Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Domain-Name: None Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Identity-Status: Confirmed Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Is-Admin-Project: True Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Project-Domain-Id: default Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Project-Domain-Name: Default Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Project-Id: 76c5181fc7be45279ac00017bb4640b3 Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Project-Name: admin Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Role: admin,reader,member Sep 13 03:14:42.158110 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Roles: admin,reader,member Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/76c5181fc7be45279ac00017bb4640b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_76c5181fc7be45279ac00017bb4640b3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/76c5181fc7be45279ac00017bb4640b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/76c5181fc7be45279ac00017bb4640b3"}]}] Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Tenant: admin Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Tenant-Id: 76c5181fc7be45279ac00017bb4640b3 Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Tenant-Name: admin Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User: admin Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User-Domain-Id: default Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User-Domain-Name: Default Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User-Id: 49f280ab086b4610855c4ffa378517d9 Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User-Name: admin Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: method: > Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: exception: Flavor 42 could not be found. Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: action_args: {'id': '42'} Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:14:42.159640 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:14:42.160539 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:42.161649 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-9ebd6e79-2da1-48b8-9b29-350952ef9225 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:14:42.162871 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-9ebd6e79-2da1-48b8-9b29-350952ef9225 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013595 Sep 13 03:14:42.162871 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Sep 13 03:14:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 13 03:14:43.364630 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-c2b2fbbe-bd52-4918-b84f-11e581c05367 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:43.365636 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-c2b2fbbe-bd52-4918-b84f-11e581c05367 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Sep 13 03:14:43.366031 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 03:14:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:14:43.881348 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-0abf2c51-9eba-424d-a4dc-2bf9c0e895ab admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:43.886931 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.wsgi [None req-0abf2c51-9eba-424d-a4dc-2bf9c0e895ab admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-0abf2c51-9eba-424d-a4dc-2bf9c0e895ab admin admin] Request method failure captured: Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Accept: application/json Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Accept-Encoding: gzip, deflate Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Connection: keep-alive Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Content-Length: 0 Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Host: 10.222.0.18 Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Openstack-Api-Version: compute 2.92 Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Openstack-System-Scope: None Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: User-Agent: python-novaclient Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Auth-Token: gAAAAABjH_WjCYFuySrVW5-7OR3c6vk6s0a3bGSuL4f1QngNeFGoOKdygYu3qHR-bZrqR_ZsZ4fViG65wfVdSzmcGBMtbAF0An9r1aIWup5ch-nYZok1gxCjCjxDnBxp7IaZVX7-Q2cDmA5gDOlZ0wAmaFdgmSKt7x-SlyVfyy--dSvKTdSZMbs Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Domain-Id: None Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Domain-Name: None Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Identity-Status: Confirmed Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Is-Admin-Project: True Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Project-Domain-Id: default Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Project-Domain-Name: Default Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Project-Id: 76c5181fc7be45279ac00017bb4640b3 Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Project-Name: admin Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Role: admin,reader,member Sep 13 03:14:43.888439 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Roles: admin,reader,member Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/76c5181fc7be45279ac00017bb4640b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_76c5181fc7be45279ac00017bb4640b3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/76c5181fc7be45279ac00017bb4640b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/76c5181fc7be45279ac00017bb4640b3"}]}] Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Tenant: admin Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Tenant-Id: 76c5181fc7be45279ac00017bb4640b3 Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Tenant-Name: admin Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User: admin Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User-Domain-Id: default Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User-Domain-Name: Default Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User-Id: 49f280ab086b4610855c4ffa378517d9 Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User-Name: admin Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: method: > Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: exception: Flavor 84 could not be found. Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: action_args: {'id': '84'} Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:14:43.890018 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:14:43.891151 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:43.892648 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-0abf2c51-9eba-424d-a4dc-2bf9c0e895ab admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:14:43.893989 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-0abf2c51-9eba-424d-a4dc-2bf9c0e895ab admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.386395 Sep 13 03:14:43.893989 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Sep 13 03:14:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 03:14:43.899580 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-240a6019-e343-4381-ae04-fe60b51c1f39 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:43.914314 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-240a6019-e343-4381-ae04-fe60b51c1f39 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018340 Sep 13 03:14:43.915359 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 13 03:14:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:14:43.924840 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-1d2b4a3b-388e-41d4-b404-a9c79e4c1839 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:43.940855 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-1d2b4a3b-388e-41d4-b404-a9c79e4c1839 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019622 Sep 13 03:14:43.941378 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 13 03:14:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:14:43.950473 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-df23cc6a-45d0-4e34-aaee-6f33373a1d6b admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:43.955535 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.wsgi [None req-df23cc6a-45d0-4e34-aaee-6f33373a1d6b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-df23cc6a-45d0-4e34-aaee-6f33373a1d6b admin admin] Request method failure captured: Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Accept: application/json Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Accept-Encoding: gzip, deflate Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Connection: keep-alive Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Content-Length: 0 Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Host: 10.222.0.18 Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Openstack-Api-Version: compute 2.92 Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Openstack-System-Scope: None Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: User-Agent: python-novaclient Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Auth-Token: gAAAAABjH_WjCYFuySrVW5-7OR3c6vk6s0a3bGSuL4f1QngNeFGoOKdygYu3qHR-bZrqR_ZsZ4fViG65wfVdSzmcGBMtbAF0An9r1aIWup5ch-nYZok1gxCjCjxDnBxp7IaZVX7-Q2cDmA5gDOlZ0wAmaFdgmSKt7x-SlyVfyy--dSvKTdSZMbs Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Domain-Id: None Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Domain-Name: None Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Identity-Status: Confirmed Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Is-Admin-Project: True Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Project-Domain-Id: default Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Project-Domain-Name: Default Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Project-Id: 76c5181fc7be45279ac00017bb4640b3 Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Project-Name: admin Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Role: admin,reader,member Sep 13 03:14:43.957052 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Roles: admin,reader,member Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/76c5181fc7be45279ac00017bb4640b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_76c5181fc7be45279ac00017bb4640b3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/76c5181fc7be45279ac00017bb4640b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/76c5181fc7be45279ac00017bb4640b3"}]}] Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Tenant: admin Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Tenant-Id: 76c5181fc7be45279ac00017bb4640b3 Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Tenant-Name: admin Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User: admin Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User-Domain-Id: default Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User-Domain-Name: Default Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User-Id: 49f280ab086b4610855c4ffa378517d9 Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User-Name: admin Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: method: > Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: exception: Flavor 84 could not be found. Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: action_args: {'id': '84'} Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:14:43.958709 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:14:43.959727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:43.961094 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-df23cc6a-45d0-4e34-aaee-6f33373a1d6b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:14:43.962498 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-df23cc6a-45d0-4e34-aaee-6f33373a1d6b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011360 Sep 13 03:14:43.962498 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 24/47] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Sep 13 03:14:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 03:14:45.178039 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-1d2b4a3b-388e-41d4-b404-a9c79e4c1839 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:45.179077 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-1d2b4a3b-388e-41d4-b404-a9c79e4c1839 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 13 03:14:45.179468 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 24/48] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 03:14:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:45.691741 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-b368a879-3733-45c9-b8ea-a281045a0cfd admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:45.697558 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.wsgi [None req-b368a879-3733-45c9-b8ea-a281045a0cfd admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-b368a879-3733-45c9-b8ea-a281045a0cfd admin admin] Request method failure captured: Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Accept: application/json Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Accept-Encoding: gzip, deflate Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Connection: keep-alive Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Content-Length: 0 Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Host: 10.222.0.18 Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Openstack-Api-Version: compute 2.92 Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Openstack-System-Scope: None Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: User-Agent: python-novaclient Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Auth-Token: gAAAAABjH_WlbFfv9J2Gt2TRzgSUvuzTPDH8ZzgIIvOGRU9OxT0yHAzNOzCo8iBVAj3CrGNWyslT26_ZWaIdXBANiVSLa48yh_KPKF-YRR1HXb79xCVJ6VkzY119Xm7NC8VRQiUg50mbVZ5i_RrWQxn3TKnqqehED3ZWPcH-AKyOeu3uIzvnEPc Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Domain-Id: None Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Domain-Name: None Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Identity-Status: Confirmed Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Is-Admin-Project: True Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Project-Domain-Id: default Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Project-Domain-Name: Default Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Project-Id: 76c5181fc7be45279ac00017bb4640b3 Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Project-Name: admin Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Role: admin,reader,member Sep 13 03:14:45.699079 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Roles: admin,reader,member Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/76c5181fc7be45279ac00017bb4640b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_76c5181fc7be45279ac00017bb4640b3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/76c5181fc7be45279ac00017bb4640b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/76c5181fc7be45279ac00017bb4640b3"}]}] Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Tenant: admin Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Tenant-Id: 76c5181fc7be45279ac00017bb4640b3 Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-Tenant-Name: admin Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User: admin Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User-Domain-Id: default Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User-Domain-Name: Default Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User-Id: 49f280ab086b4610855c4ffa378517d9 Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: X-User-Name: admin Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: method: > Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: exception: Flavor 451 could not be found. Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: action_args: {'id': '451'} Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:14:45.700725 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:14:45.701727 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 13 03:14:45.703082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-b368a879-3733-45c9-b8ea-a281045a0cfd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:14:45.704343 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-b368a879-3733-45c9-b8ea-a281045a0cfd admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.383141 Sep 13 03:14:45.704343 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 25/49] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 13 03:14:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 03:14:45.710349 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-52b1731a-5e45-47e9-866c-77fe6932b6cf admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:45.725226 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-52b1731a-5e45-47e9-866c-77fe6932b6cf admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018508 Sep 13 03:14:45.725817 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 13 03:14:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:14:45.735336 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:45.750596 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018722 Sep 13 03:14:45.751153 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 26/51] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 13 03:14:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:14:45.760755 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-b19130c6-2d6a-4178-9e62-47b80be83a88 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:45.765697 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.wsgi [None req-b19130c6-2d6a-4178-9e62-47b80be83a88 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-b19130c6-2d6a-4178-9e62-47b80be83a88 admin admin] Request method failure captured: Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Accept: application/json Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Accept-Encoding: gzip, deflate Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Connection: keep-alive Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Content-Length: 0 Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Host: 10.222.0.18 Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Openstack-Api-Version: compute 2.92 Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Openstack-System-Scope: None Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: User-Agent: python-novaclient Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Auth-Token: gAAAAABjH_WlbFfv9J2Gt2TRzgSUvuzTPDH8ZzgIIvOGRU9OxT0yHAzNOzCo8iBVAj3CrGNWyslT26_ZWaIdXBANiVSLa48yh_KPKF-YRR1HXb79xCVJ6VkzY119Xm7NC8VRQiUg50mbVZ5i_RrWQxn3TKnqqehED3ZWPcH-AKyOeu3uIzvnEPc Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Domain-Id: None Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Domain-Name: None Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Identity-Status: Confirmed Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Is-Admin-Project: True Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Project-Domain-Id: default Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Project-Domain-Name: Default Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Project-Id: 76c5181fc7be45279ac00017bb4640b3 Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Project-Name: admin Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Role: admin,reader,member Sep 13 03:14:45.767227 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Roles: admin,reader,member Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/76c5181fc7be45279ac00017bb4640b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_76c5181fc7be45279ac00017bb4640b3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/76c5181fc7be45279ac00017bb4640b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/76c5181fc7be45279ac00017bb4640b3"}]}] Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Tenant: admin Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Tenant-Id: 76c5181fc7be45279ac00017bb4640b3 Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-Tenant-Name: admin Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User: admin Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User-Domain-Id: default Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User-Domain-Name: Default Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User-Id: 49f280ab086b4610855c4ffa378517d9 Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: X-User-Name: admin Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: method: > Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: exception: Flavor 451 could not be found. Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: action_args: {'id': '451'} Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:14:45.768805 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:14:45.769945 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 13 03:14:45.771140 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-b19130c6-2d6a-4178-9e62-47b80be83a88 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:14:45.772163 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-b19130c6-2d6a-4178-9e62-47b80be83a88 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012079 Sep 13 03:14:45.772163 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 26/52] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 13 03:14:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 03:14:46.988634 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:46.989635 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 13 03:14:46.990026 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 03:14:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:47.503893 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-83ed4399-1a11-44bd-8418-b0a4f2f75fdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:47.522588 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-83ed4399-1a11-44bd-8418-b0a4f2f75fdd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.395665 Sep 13 03:14:47.523148 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 27/54] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Sep 13 03:14:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:14:48.743470 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:48.744460 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002010 Sep 13 03:14:48.744849 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 03:14:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:49.255585 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-1343964a-3812-4996-9683-8a229ccfce1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:49.274446 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-1343964a-3812-4996-9683-8a229ccfce1e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.393525 Sep 13 03:14:49.275019 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 28/56] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Sep 13 03:14:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:14:50.479649 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:50.480657 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 13 03:14:50.481082 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 03:14:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:50.996159 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-dd4e086b-7407-46ef-903a-82c1b737b791 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:51.014555 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-dd4e086b-7407-46ef-903a-82c1b737b791 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.395619 Sep 13 03:14:51.015114 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 29/58] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Sep 13 03:14:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:14:52.232481 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:52.233480 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 13 03:14:52.233871 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 30/59] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 03:14:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:52.750924 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-18076135-2714-4864-baa2-71bfa6c034f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:14:52.769888 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-18076135-2714-4864-baa2-71bfa6c034f6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.397993 Sep 13 03:14:52.770428 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 30/60] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Sep 13 03:14:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 03:14:53.985772 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:53.986864 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 13 03:14:53.987258 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 31/61] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 03:14:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:14:54.501271 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-2248f715-4df7-42d5-a531-73f87273167a admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:14:54.522128 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-2248f715-4df7-42d5-a531-73f87273167a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.396137 Sep 13 03:14:54.522683 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 31/62] 10.222.0.18 () {60 vars in 1202 bytes} [Tue Sep 13 03:14:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:15:50.679677 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:15:50.680688 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-95790cf9-5b07-4a28-82ac-e0e7ad543d4d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 13 03:15:50.681086 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 32/63] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 03:15:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:15:50.691652 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:51.067520 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-29421f8e-6c7b-478d-a630-622d56bf23fc admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:15:51.088572 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-29421f8e-6c7b-478d-a630-622d56bf23fc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401356 Sep 13 03:15:51.089100 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 32/64] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Sep 13 03:15:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:15:51.110248 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=14 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:51.113939 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-0f7b6816-7f14-4db1-99a1-237d9734d088 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:15:51.121783 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-0f7b6816-7f14-4db1-99a1-237d9734d088 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013042 Sep 13 03:15:51.122292 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 33/65] 10.222.0.18 () {60 vars in 1283 bytes} [Tue Sep 13 03:15:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:15:51.134501 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-84471593-8be1-48d9-a4c1-889c62140819 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:15:51.141785 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-84471593-8be1-48d9-a4c1-889c62140819 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011449 Sep 13 03:15:51.142304 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 33/66] 10.222.0.18 () {60 vars in 1286 bytes} [Tue Sep 13 03:15:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:15:51.153184 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-9408c013-233a-4bfe-bc00-a2e2f1299f8e admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:15:51.160287 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-9408c013-233a-4bfe-bc00-a2e2f1299f8e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010468 Sep 13 03:15:51.160803 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 34/67] 10.222.0.18 () {60 vars in 1286 bytes} [Tue Sep 13 03:15:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:15:51.172071 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-68c23607-423d-48bf-840f-fee4365d4cd3 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:15:51.179855 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-68c23607-423d-48bf-840f-fee4365d4cd3 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011259 Sep 13 03:15:51.180364 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1283 bytes} [Tue Sep 13 03:15:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:18:49.735403 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-9408c013-233a-4bfe-bc00-a2e2f1299f8e admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:18:49.736492 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-9408c013-233a-4bfe-bc00-a2e2f1299f8e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 13 03:18:49.736842 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 03:18:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:18:49.877445 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_api:SELECT=6 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:18:50.039664 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-7c90a8af-baae-4aa7-a673-2eb76ca18cb4 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:18:50.044313 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-7c90a8af-baae-4aa7-a673-2eb76ca18cb4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:18:50.044781 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-7c90a8af-baae-4aa7-a673-2eb76ca18cb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:18:50.045202 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-7c90a8af-baae-4aa7-a673-2eb76ca18cb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:18:50.045900 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-7c90a8af-baae-4aa7-a673-2eb76ca18cb4 admin admin] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:18:50.046338 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-7c90a8af-baae-4aa7-a673-2eb76ca18cb4 admin admin] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:18:50.047042 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-7c90a8af-baae-4aa7-a673-2eb76ca18cb4 admin admin] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:18:50.078388 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-7c90a8af-baae-4aa7-a673-2eb76ca18cb4 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.202147 Sep 13 03:18:50.078974 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 35/70] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 13 03:18:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:18:51.153951 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-9408c013-233a-4bfe-bc00-a2e2f1299f8e admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:18:51.155012 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-9408c013-233a-4bfe-bc00-a2e2f1299f8e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 13 03:18:51.155410 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 03:18:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:18:51.352343 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-e76b4128-90fe-49a9-94a8-918f3de05a47 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:18:51.355767 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-e76b4128-90fe-49a9-94a8-918f3de05a47 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:18:51.356245 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-e76b4128-90fe-49a9-94a8-918f3de05a47 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:18:51.356675 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-e76b4128-90fe-49a9-94a8-918f3de05a47 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:18:51.357395 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-e76b4128-90fe-49a9-94a8-918f3de05a47 admin admin] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:18:51.357846 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-e76b4128-90fe-49a9-94a8-918f3de05a47 admin admin] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:18:51.358265 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-e76b4128-90fe-49a9-94a8-918f3de05a47 admin admin] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:18:51.377934 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-e76b4128-90fe-49a9-94a8-918f3de05a47 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078559 Sep 13 03:18:51.378493 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 36/72] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 13 03:18:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:19:02.873282 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-9408c013-233a-4bfe-bc00-a2e2f1299f8e admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:19:02.874281 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-9408c013-233a-4bfe-bc00-a2e2f1299f8e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 13 03:19:02.874697 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 03:19:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:19:03.022449 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_cell0:SELECT=4 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:19:03.023176 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_cell1:SELECT=4 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:19:03.023937 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_api:SELECT=8 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:19:03.072149 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-dbca5ab8-858e-492b-92b6-1984466fc609 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:19:03.075551 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-dbca5ab8-858e-492b-92b6-1984466fc609 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:19:03.076022 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-dbca5ab8-858e-492b-92b6-1984466fc609 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:19:03.076443 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-dbca5ab8-858e-492b-92b6-1984466fc609 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:19:03.077148 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-dbca5ab8-858e-492b-92b6-1984466fc609 admin admin] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:19:03.077643 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-dbca5ab8-858e-492b-92b6-1984466fc609 admin admin] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:19:03.077996 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-dbca5ab8-858e-492b-92b6-1984466fc609 admin admin] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:19:03.103246 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-dbca5ab8-858e-492b-92b6-1984466fc609 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085684 Sep 13 03:19:03.103785 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 37/74] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 13 03:19:03 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:19:04.177050 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-9408c013-233a-4bfe-bc00-a2e2f1299f8e admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:19:04.178670 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-9408c013-233a-4bfe-bc00-a2e2f1299f8e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Sep 13 03:19:04.179067 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 03:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:19:04.367609 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-9fed704a-f6ef-4773-9527-218438aaf70c admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:19:04.370990 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-9fed704a-f6ef-4773-9527-218438aaf70c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:19:04.371491 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-9fed704a-f6ef-4773-9527-218438aaf70c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:19:04.371911 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-9fed704a-f6ef-4773-9527-218438aaf70c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:19:04.372611 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-9fed704a-f6ef-4773-9527-218438aaf70c admin admin] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:19:04.373181 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-9fed704a-f6ef-4773-9527-218438aaf70c admin admin] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:19:04.373601 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-9fed704a-f6ef-4773-9527-218438aaf70c admin admin] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:19:04.394487 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-9fed704a-f6ef-4773-9527-218438aaf70c admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.077776 Sep 13 03:19:04.395051 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 38/76] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 13 03:19:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:20:01.762151 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: Tue Sep 13 03:20:01 2022 - graceful shutdown triggered... Sep 13 03:20:01.762658 dv-cinder-857075-2-iscsi devstack@n-api.service[105409]: Gracefully killing worker 1 (pid: 105409)... Sep 13 03:20:01.762268 dv-cinder-857075-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 03:20:01.763461 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: Gracefully killing worker 2 (pid: 105410)... Sep 13 03:20:01.889641 dv-cinder-857075-2-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=4 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:20:02.763291 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: worker 1 buried after 1 seconds Sep 13 03:20:02.763867 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: worker 2 buried after 1 seconds Sep 13 03:20:02.763867 dv-cinder-857075-2-iscsi devstack@n-api.service[105408]: goodbye to uWSGI. Sep 13 03:20:02.764887 dv-cinder-857075-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 03:20:02.765467 dv-cinder-857075-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 03:20:02.768304 dv-cinder-857075-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 03:20:02.777433 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 03:20:02.779683 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 03:20:02 2022] *** Sep 13 03:20:02.779683 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 03:20:02.779683 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 03:20:02.779683 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: nodename: dv-cinder-857075-2-iscsi Sep 13 03:20:02.779683 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: machine: x86_64 Sep 13 03:20:02.779683 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: clock source: unix Sep 13 03:20:02.779683 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: pcre jit disabled Sep 13 03:20:02.779683 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: detected number of CPU cores: 4 Sep 13 03:20:02.779683 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: current working directory: / Sep 13 03:20:02.779683 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: detected binary path: /usr/bin/uwsgi-core Sep 13 03:20:02.780341 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: your processes number limit is 47680 Sep 13 03:20:02.780341 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: your memory page size is 4096 bytes Sep 13 03:20:02.780341 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: detected max file descriptor number: 2048 Sep 13 03:20:02.780341 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: lock engine: pthread robust mutexes Sep 13 03:20:02.780341 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: thunder lock: enabled Sep 13 03:20:02.780341 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 03:20:02.780341 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 03:20:02.820535 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: Python main interpreter initialized at 0x55f03e1e19c0 Sep 13 03:20:02.820535 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: python threads support enabled Sep 13 03:20:02.820535 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: your server socket listen backlog is limited to 100 connections Sep 13 03:20:02.820535 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: your mercy for graceful operations on workers is 90 seconds Sep 13 03:20:02.820915 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 03:20:02.820993 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: *** Operational MODE: preforking *** Sep 13 03:20:02.821233 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: *** uWSGI is running in multiple interpreter mode *** Sep 13 03:20:02.821233 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: spawned uWSGI master process (pid: 120370) Sep 13 03:20:02.821445 dv-cinder-857075-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 03:20:02.821970 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: spawned uWSGI worker 1 (pid: 120383, cores: 1) Sep 13 03:20:02.826636 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: spawned uWSGI worker 2 (pid: 120384, cores: 1) Sep 13 03:20:02.826636 dv-cinder-857075-2-iscsi devstack@n-api.service[120370]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 03:20:03.488771 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 03:20:03.489376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 03:20:04.641705 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 03:20:04.641705 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: from cryptography.utils import int_from_bytes Sep 13 03:20:04.642434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 03:20:04.642434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: from cryptography.utils import int_from_bytes Sep 13 03:20:04.645402 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 03:20:04.645402 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: from cryptography.utils import int_from_bytes Sep 13 03:20:04.645857 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 03:20:04.645857 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: from cryptography.utils import int_from_bytes Sep 13 03:20:07.042456 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 03:20:07.043226 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 03:20:07.043341 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 03:20:07.043680 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 03:20:07.043896 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 03:20:07.044244 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.044799 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.045321 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.046102 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.046663 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.046970 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 03:20:07.047385 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.047481 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 03:20:07.047569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.047796 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 03:20:07.050539 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.050676 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 03:20:07.050775 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.050860 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 03:20:07.050944 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.050944 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.051095 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.051095 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.051244 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857075-2-iscsi {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.051324 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.051398 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.051484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.051565 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.051647 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.051728 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.051808 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.051900 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.051974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.052053 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.052132 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.052205 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.052287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.052373 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.052457 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.052539 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.052627 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.052706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.052787 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857075-2-iscsi {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.052862 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.052938 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.053017 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.053096 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.053180 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.053266 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.055591 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.055833 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.056073 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.056323 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.056548 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.056803 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.057028 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.057241 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.057452 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.057452 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.057976 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.057976 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.058404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857075-2-iscsi {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.058624 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.058855 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.059093 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.059302 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.059556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.059771 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.059991 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.060214 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.060458 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.060680 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.060863 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.061090 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.061253 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.061454 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.061603 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.061795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.061953 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.062112 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.062270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857075-2-iscsi {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.062459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.062718 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.062885 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.063043 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.063198 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.063361 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.063517 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.063517 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.063845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.064013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.064168 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.064332 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.064487 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.064636 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.064794 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.064950 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.065110 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.066286 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.066512 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.066700 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.066855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.067011 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.067178 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.067334 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.067484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.067639 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.067799 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.067958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.068121 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.068278 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.068278 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.068569 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.068718 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.068881 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.069036 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.069192 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.069349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.069504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.069672 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.069841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.069990 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.070144 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.070292 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.070438 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.070586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.070773 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.070931 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.071086 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.071243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.071397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.071569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.071718 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.071718 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.072009 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.072164 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.072319 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.072484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.072633 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.072792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.072940 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.073086 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.073243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.073414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.073570 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.073720 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.073867 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.074015 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.074171 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.074327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.074474 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.074640 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.074805 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.074954 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.075110 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.075258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.075431 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.075598 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.075758 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.075908 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.076071 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.076408 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.076578 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.076734 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.076891 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.076891 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.077189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.077189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.077496 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.077645 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.077792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.077792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.078090 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.078238 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.078387 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.079244 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.079416 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.079576 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.079732 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.079880 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.080047 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.080204 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.080378 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.080528 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.080675 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.080837 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.080986 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.081142 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.081305 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.081455 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.081609 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.081756 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.081914 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.082082 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.082245 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.082401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.082556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.082739 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.082890 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.083046 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.083196 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.083343 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.083490 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.083646 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.083794 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.083956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.084122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.084283 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.084430 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.084578 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.084733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.084895 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.085056 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.085211 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.085367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.085536 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.085697 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.085855 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.086003 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.086177 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.086355 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.086733 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.086903 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.087053 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.087208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.087403 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.087570 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.087726 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.087890 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.088045 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.088203 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.088361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.088529 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.088693 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.088877 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.089036 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.089184 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.089349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.089499 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.089654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.089810 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.089967 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.090759 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.090932 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.091083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.091248 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.091403 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.091552 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.091710 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.091866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.092023 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.092181 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.092359 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.092510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.092667 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.092822 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.092980 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.093142 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.093300 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.093448 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.093448 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.093728 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.093875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.094032 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.094032 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.094320 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.094320 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.094604 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.094604 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.094952 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.095101 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.095248 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.095394 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.095559 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.095791 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.095949 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.096106 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.096260 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.096416 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.096592 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.096951 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.097117 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.097284 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.097440 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.097597 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.097597 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.097887 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.098036 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.098191 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.098339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.098493 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.098681 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.098836 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.098994 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.099160 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.099317 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:20:07.099473 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.099636 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.099786 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.099943 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.100099 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.100738 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.100890 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.101053 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.101202 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.101357 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.101507 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.101674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.101836 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.101986 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.102145 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.102301 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.102450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.102750 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.109269 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.109993 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.110161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.110321 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.110498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.110672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.110672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.111012 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.111012 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.111304 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.111304 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.111593 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.111749 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.112251 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.112418 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.112545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.112667 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.112790 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.113032 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.113216 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.113366 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.113522 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.113678 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.113827 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.113984 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.114133 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.114281 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.114429 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.114584 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.114835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.114835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.115159 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.115308 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.115491 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.115646 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.115796 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.116591 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.117289 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.117444 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.117575 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.117699 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.117835 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.117960 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.118087 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.118208 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.118330 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.118444 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.118567 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.118989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.119154 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.119343 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.119556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.119717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.119878 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.120027 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.120191 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.120349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.120506 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.120662 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.120820 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.120970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.121116 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.121264 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.121411 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.121411 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.121411 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.121910 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.123081 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.123266 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.123427 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.123586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.123586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.123891 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.124040 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.124196 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.124391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.124563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.124563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.124563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.124563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.124563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.124563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.124563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.124563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.125684 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.125684 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.125684 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.126097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.126256 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.126405 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.126553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.126753 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.126921 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.126921 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.127729 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.127880 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.128041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.128191 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.128341 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.128498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.128498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.128498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.128498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.128498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.129870 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.130037 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.130196 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.130366 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.130515 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.130683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.130683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.131098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.131098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.131517 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.131730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.131923 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.132034 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.132216 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.132390 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.132560 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.132560 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.132866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.133023 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.133172 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.133327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.133494 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.133669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.133834 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.134070 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.134070 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.134360 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.134360 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.134717 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.134884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.135021 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.135121 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.135204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.135359 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.135508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.135681 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.135836 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.135985 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.136132 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.136287 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.136435 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.136435 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.136749 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.136897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.137043 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.137401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.137401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.137401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.137401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.137401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.137401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.137401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.138686 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.138855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.139011 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.139166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.139166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.139166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.139166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.139166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.139166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.140052 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.140204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.140361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.140524 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.140680 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.140841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.140996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.141151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.141300 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.141461 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.141617 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.141764 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.141912 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.142060 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.142060 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.142362 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.142511 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.142676 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.142676 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.142974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.143146 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.143296 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.143450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.143598 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.143746 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.143901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.143901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.144195 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.144195 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.144498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.144654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.144812 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.144976 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.145133 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.145133 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.145412 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.145560 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.145715 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.145888 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.146053 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.146204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.146358 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.146507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.146507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.146507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.146507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.146507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.147308 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.147615 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.147615 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.148208 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.148359 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.148514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.148664 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.148811 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.148968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.149128 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.149277 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.149430 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.149604 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.150307 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.150493 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.150664 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.150835 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.150986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.151145 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.151145 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.151442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.151591 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.151750 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.151906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.152061 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.152220 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.152377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.152526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.152674 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.152820 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.152976 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.153134 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.153134 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.153134 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.153134 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.153715 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.153869 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.154036 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.154199 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.154354 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.154516 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.154715 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.154887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.154887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.155198 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.155354 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.155508 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.155673 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.155863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.156020 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.156175 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.156336 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.156498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.156661 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.156824 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.156979 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.157132 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.157293 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.157455 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.157788 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.158234 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.158409 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.158564 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.158744 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.158899 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.159053 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.159227 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.159390 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.159544 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.159697 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.159851 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.160019 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.160174 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.160329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.160329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.160642 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.160891 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.161069 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.161226 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.161381 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.161549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.161712 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.161877 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.162041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.162205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.162366 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.162533 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.163377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.163537 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.163707 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.163870 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.164034 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.164197 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.164352 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.164521 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.164683 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.164838 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.164993 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.165154 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.165326 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.165561 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.165724 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.165879 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.166151 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.166331 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.166496 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.166689 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.166859 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.167015 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.167172 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.167333 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.167488 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.167668 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.168023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.168432 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.168605 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.168761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.168930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.169094 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.169257 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.169412 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.169567 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.169736 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.169901 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.170056 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.170225 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.170379 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.170544 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.170992 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.171161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.171161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.171462 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.171462 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.171754 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.171931 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.172096 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.172096 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.172416 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.172571 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.172735 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.172890 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.173044 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.173205 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.173361 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.173524 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.173679 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.173842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.173997 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.174160 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.174315 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.174493 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.174683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.174683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.175003 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.175159 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.175326 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.175491 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.175653 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.175809 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.175963 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.176125 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.176303 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.176459 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.176625 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.176780 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.180585 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.180763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.180940 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.181104 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.181283 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.181448 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.181605 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.181762 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.181931 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.182087 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.182242 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.182410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.182565 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.182761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.182928 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.183092 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.183255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.183411 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.183573 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.183737 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.183895 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.184049 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.184211 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.184377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.184377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.184694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.184852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.185014 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.185178 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.185380 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.185568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.185725 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.185888 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.186148 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.186406 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.186695 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.186953 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.187209 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.187627 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.187884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.188169 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.188452 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.188771 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.188771 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.189268 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.189530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.189860 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.190941 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.191218 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.191501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.191758 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.192043 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.192307 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.192565 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.192839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.193170 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.193433 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.193703 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.193997 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.194261 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.194524 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.194934 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.195244 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.195516 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.195787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.195787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.196182 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.196351 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.196517 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.196683 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.196847 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.197010 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.197203 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.197368 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.197680 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.197843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.197999 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.198161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.198316 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.198470 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.198661 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.198661 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.198975 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.198975 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.199313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.199468 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.199633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.199633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.199940 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.200103 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.200277 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.200694 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.201054 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.201228 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.201393 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.201556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.201556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.201869 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.202031 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.202193 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.202368 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.202531 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.202711 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.202711 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.203028 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.203028 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.203376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.203376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.203679 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.203849 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.204005 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.204159 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.204325 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.204487 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.204652 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.204808 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.204970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.205133 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.205287 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.205449 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.205684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.205842 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.205995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.206156 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.206322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.206489 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.206696 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.206858 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.206858 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.207169 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.207364 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.207523 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.207720 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.207879 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.208036 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.208197 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.208358 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.208522 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.208694 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.208849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.209004 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.209173 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.209329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.209329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.209654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.209654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.209959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.210122 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.210285 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.210449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.210833 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.211192 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.211392 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.211565 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.211729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.211899 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.212056 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.212218 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.212373 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.212577 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.212735 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.212903 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.213066 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.213214 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.213315 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.213444 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.213618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.213618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.213781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.213874 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.213969 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.214064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.214202 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.214331 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.214461 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.214577 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.214749 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.214874 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.215003 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.215118 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.215230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.215343 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.215499 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.215627 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.215751 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.215872 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.215992 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.216113 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.216242 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.216375 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.216498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.216613 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.216732 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.216847 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.216959 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.217081 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.217195 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.217308 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.217429 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.217542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.217663 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.217789 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.217912 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.218032 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.218365 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.218489 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.218630 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.218766 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.218899 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.218899 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.219121 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.219234 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.219360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.219482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.219597 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.219718 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.219830 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.219951 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.220073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.220194 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.220307 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.220419 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.220538 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.220658 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.220978 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.221109 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.221252 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.221546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.221687 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.221837 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.221969 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.222091 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.222212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.222327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.222446 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.222570 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.222752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.222881 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.222996 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.223108 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.223229 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.223357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.223513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.223642 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.223764 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.223886 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.224009 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.224137 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.224259 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.224381 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.224381 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.224602 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.224715 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.224838 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.224838 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.225065 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.225178 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.225827 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.225952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.226066 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.226186 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.226307 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.226436 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.226560 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.226716 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.226855 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.226933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.227006 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.227087 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.227167 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.227254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.227329 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.227401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.227474 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.227552 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.227631 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.227714 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.227796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.227870 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.227943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.228015 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.228095 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.228169 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.228247 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.228247 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.228404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.228485 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.228572 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.228572 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.228720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.228720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.228859 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.228939 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.229021 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.229103 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.229187 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.229269 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.229349 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.229423 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.229508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.229582 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.229654 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.229654 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.229791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.229791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.229939 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.230013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.230091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.230171 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.230244 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.230324 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.230399 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.230471 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.230549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.230549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.230549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.230549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.230549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.232108 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.232225 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.232338 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.232459 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.232587 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.232708 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.232833 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.232957 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.233081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.233197 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.233325 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.233440 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.233560 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.233685 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.233817 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.233939 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.234053 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.234175 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.234289 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.234402 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.234523 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.234657 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.234790 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.234914 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.235036 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.235160 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.235276 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.235388 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.235501 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.235621 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.235741 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.235864 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.235979 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.236091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.236091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.236310 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.236422 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.236547 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.236675 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.236793 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.236907 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.237028 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.237156 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.237285 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.237408 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.237529 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.237651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.237772 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.237895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.238009 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.238129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.238242 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.238355 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.238467 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.238589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.238740 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.238866 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.238980 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.239100 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.239222 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.239345 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.239467 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.239588 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.239588 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.239848 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.239967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.240095 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.240095 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.240323 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.240446 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.240561 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.240682 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.240797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.241680 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.241990 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.242131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.242275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.242275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.242508 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.242675 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.242795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.242922 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.243038 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.243160 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.243274 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.243394 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.243515 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.243629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.243755 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.243870 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.243981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.244101 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.244214 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.244335 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.244457 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.244572 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.244693 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.244807 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.244918 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.245031 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.245158 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.245272 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.245393 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.245507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.245627 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.245749 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.245872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.245995 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.246107 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.246230 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.246344 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.246470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.246585 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.246742 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.246870 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.246995 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.247109 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.247231 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.247344 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.247464 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.247586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.247700 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.247822 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.247987 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.248110 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.248224 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.248336 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.248448 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.248560 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.248681 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.248795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.248908 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.249020 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.249139 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.249266 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.249390 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.249504 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.249617 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.249736 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.249849 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.249975 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.250089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.250089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.250307 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.250307 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.250532 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.250678 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.250872 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.251022 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.251213 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.251344 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.251469 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.251617 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.251903 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.252188 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.252327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.252448 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.252571 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.252692 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.252812 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.252933 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.253048 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.253160 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.253305 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.253565 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.253686 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.253800 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.253913 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.254034 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.254194 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.254310 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.254432 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.254546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.254724 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.254862 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.254985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.255100 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.255222 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.255337 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.255457 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.255579 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.255694 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.255806 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.255917 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.256032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.256152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.256278 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.256392 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.256540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.256668 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.256794 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.256916 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.257031 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.257157 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.257279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.257400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.257514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.257636 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.257760 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.257881 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.258002 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.258161 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.258284 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.258409 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.258523 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.258664 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.258785 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.258905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.259044 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.259159 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.259272 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.259499 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.259666 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.259792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.259985 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.260109 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.260231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.260347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.260605 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.260725 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.260852 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.260974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.261088 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.261088 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.261400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.261400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.261640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.261754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.262022 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.262329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.262473 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.262634 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.262762 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.262889 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.263018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.263143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.263265 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.263394 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.263510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.263623 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.263742 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.263863 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.264021 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.264155 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.264271 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.264384 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.264504 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.264620 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.264732 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.264854 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.264975 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.265097 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.265210 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.265322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.265449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.265570 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.265684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.265797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.265916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.266037 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.266180 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.266398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.266545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.266726 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.266864 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.266991 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.267105 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.267228 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.267349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.267472 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.267592 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.267716 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.267840 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.267954 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.268075 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.268189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.268302 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.268428 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.268544 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.269209 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.269340 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.269464 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.269585 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.269701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.269821 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.269946 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.270060 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.270182 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.270304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.270419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.270820 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.270951 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.271073 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.271189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.271301 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.271438 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.271641 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.271760 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.271874 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.272190 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.272339 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.272657 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.272803 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.272926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.272926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.273147 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.273261 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.273374 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.273497 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.273619 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.273740 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.273862 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.273992 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.274108 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.274230 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.274344 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.274456 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.274569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.274707 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.274837 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.274960 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.275082 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.275196 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.275308 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.275308 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.275536 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.275657 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.275772 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.275892 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.276006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.276120 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.276242 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.276370 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.276485 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.276604 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.276743 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.276860 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.276989 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.277111 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.277243 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.277243 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.277454 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.277579 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.277694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.277807 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.277920 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.278041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.278162 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.278353 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.278470 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.278470 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.278817 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.278935 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.279061 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.279185 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.279307 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.279421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.279535 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.279654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.279776 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.279904 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.280065 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.280193 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.280315 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.280429 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.280557 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.280680 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.280802 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.280931 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.281046 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.281165 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.281289 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.281405 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.281525 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.281656 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.281852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.281971 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.282275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.282377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.282454 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.282549 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.282956 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.283091 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.283190 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.283288 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.283376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.283462 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.283554 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.283655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.283743 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.283830 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.283915 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.284001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.284086 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.284185 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.284279 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.284367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.284461 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.284556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.284649 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.284745 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.284833 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.284925 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.285012 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.285096 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.285195 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.285283 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.285375 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.285469 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.285557 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.285642 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.285736 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.285829 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.285916 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.286008 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.286103 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.286190 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.286284 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.286371 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.286456 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.286542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.286876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.287001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.287171 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.287291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.287291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.287515 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.287631 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.288269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.288391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.288515 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.288515 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.288734 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.288825 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.288922 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.289010 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.289097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.289183 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.289276 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.289370 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.289467 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.289555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.289640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.289726 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.289812 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.289907 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.290001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.290089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.290175 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.290267 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.290354 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.290448 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.290544 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.290842 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.290993 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.291172 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.291290 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.291414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.291509 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.291630 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.291734 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.291852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.291997 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.292098 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.292188 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.292313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.292404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.292490 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.292702 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.292814 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.293091 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.293232 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.293331 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.293426 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.293523 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.293611 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.293755 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.293848 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.293944 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.294041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.294137 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.294225 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.294318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.294411 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.294505 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.294600 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.294706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.294805 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.294906 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.294995 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.295081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.295176 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.295263 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.295349 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.295443 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.295530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.295885 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.295983 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.296098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.296193 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.296286 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.296374 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.296473 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.296568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.296655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.296748 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.296842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.296929 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.297023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.297114 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.297200 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.297285 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.297384 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.297477 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.297574 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.297667 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.297761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.297848 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.297934 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.298027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.298129 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.298227 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.298314 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.298407 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.298494 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.298587 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.298706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.298796 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.298891 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.298978 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.299119 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.299291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.299440 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.299536 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.299744 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.299841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.300048 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.300158 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.300351 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.300447 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.300657 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.300758 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.300974 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.301070 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.301281 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.301375 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.301584 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.301677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.301890 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.302056 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.302196 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.302325 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.302565 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.302875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.303226 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.303357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.303477 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.304073 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.304198 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.304343 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.304528 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.304686 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.304845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.304993 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.305161 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.305298 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.305476 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.305603 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.305795 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.305910 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.306111 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.306214 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.306426 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.306521 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.306778 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.306887 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.307100 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.307205 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.307404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.307498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.307709 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.307803 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.308019 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.308122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.308322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.308423 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.308656 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.308766 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.309020 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.309119 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.309328 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.309422 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.309649 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.309743 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.309961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.310056 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.310283 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.310389 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.310591 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.310871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.310975 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.311063 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.311172 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 03:20:07.311268 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.311562 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.311873 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.312206 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.312575 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.312850 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.313156 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.314257 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.314585 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.314933 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.315267 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.315599 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.315909 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.316235 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.316554 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.316876 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.317322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.317634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.317970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.318282 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.318594 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.318930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.319270 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.319581 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.319997 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.320251 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.320527 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.320842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.321158 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.321485 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.321810 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.322118 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.322444 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.322800 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.323152 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.323459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.323805 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.324134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.324448 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.324759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.325062 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:20:07.325304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 03:20:07.375769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO dbcounter [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] Registered counter for database nova_api Sep 13 03:20:07.386149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO dbcounter [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] Registered counter for database nova_api Sep 13 03:20:07.395872 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:20:07.402982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writer thread running {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:20:07.406356 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_db.sqlalchemy.engines [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:20:07.413381 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writer thread running {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:20:07.459337 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.context [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8232eabc-875a-4f0b-84ce-ecae7315d84c(cell1) {{(pid=120383) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 03:20:07.463922 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:20:07.464402 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:20:07.465959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:20:07.466731 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:20:07.467186 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:20:07.468656 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.context [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8232eabc-875a-4f0b-84ce-ecae7315d84c(cell1) {{(pid=120384) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 03:20:07.469183 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:20:07.471200 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO dbcounter [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] Registered counter for database nova_cell0 Sep 13 03:20:07.472676 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:20:07.473151 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:20:07.474729 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:20:07.475236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO dbcounter [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] Registered counter for database nova_cell1 Sep 13 03:20:07.476041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:20:07.476495 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:20:07.478654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:20:07.480488 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO dbcounter [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] Registered counter for database nova_cell0 Sep 13 03:20:07.482705 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:20:07.484553 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO dbcounter [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] Registered counter for database nova_cell1 Sep 13 03:20:07.486740 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:20:07.488301 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writer thread running {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:20:07.491488 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_db.sqlalchemy.engines [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:20:07.496767 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writer thread running {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:20:07.497401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_db.sqlalchemy.engines [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:20:07.630652 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writer thread running {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:20:07.639458 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO dbcounter [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] Registered counter for database nova_cell0 Sep 13 03:20:07.640530 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writer thread running {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:20:07.646413 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:20:07.650109 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO dbcounter [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] Registered counter for database nova_cell0 Sep 13 03:20:07.651695 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writer thread running {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:20:07.658141 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_db.sqlalchemy.engines [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:20:07.662533 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writer thread running {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:20:07.972274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: WARNING keystonemiddleware.auth_token [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 03:20:07.979668 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: WARNING keystonemiddleware.auth_token [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 03:20:07.980241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: WARNING keystonemiddleware.auth_token [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 03:20:07.987439 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: WARNING keystonemiddleware.auth_token [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 03:20:08.324456 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: WARNING keystonemiddleware.auth_token [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 03:20:08.331615 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: WARNING keystonemiddleware.auth_token [None req-4b0008dc-3abc-4252-9222-18a0ce7a477b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 03:20:08.337143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f03e1e19c0 pid: 120383 (default app) Sep 13 03:20:08.339129 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: WARNING keystonemiddleware.auth_token [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 03:20:08.345118 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: WARNING keystonemiddleware.auth_token [None req-7029a2ae-389f-4f75-8d07-78da5f3158c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 03:20:08.350354 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f03e1e19c0 pid: 120384 (default app) Sep 13 03:20:44.210140 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=3 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:20:44.211256 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=3 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:20:44.212012 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=3 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:20:44.212733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=3 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:20:45.807419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-07a13435-65f4-4822-adb6-8ec87b9bd760 tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] Action: 'create', calling method: .version_select at 0x7f89367c2430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-282526175", "metadata": {"Type": "work"}}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:20:46.928191 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-07a13435-65f4-4822-adb6-8ec87b9bd760 tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.730422 Sep 13 03:20:46.929557 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Sep 13 03:20:44 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2734 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 03:20:46.952843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=3 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:20:46.955260 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=3 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:20:46.958121 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=3 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:20:46.969958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=3 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:20:47.526892 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-00c2c166-5219-4ae3-885f-45ae13b3824c tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] Calling method '.version_select at 0x7f8936876940>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:20:48.145222 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-00c2c166-5219-4ae3-885f-45ae13b3824c tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/77bfc232-843f-4280-bd43-e4af694a886f" status: 200 len: 352 microversion: 2.1 time: 1.202363 Sep 13 03:20:48.152859 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 1/2] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:20:46 2022] GET /compute/v2.1/os-volumes/77bfc232-843f-4280-bd43-e4af694a886f => generated 352 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:20:49.164825 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-35d51380-6bae-43b3-b682-602465a9e9af tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] Calling method '.version_select at 0x7f8936697310>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:20:49.283186 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-35d51380-6bae-43b3-b682-602465a9e9af tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/77bfc232-843f-4280-bd43-e4af694a886f" status: 200 len: 353 microversion: 2.1 time: 0.126310 Sep 13 03:20:49.283779 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:20:49 2022] GET /compute/v2.1/os-volumes/77bfc232-843f-4280-bd43-e4af694a886f => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:20:49.298707 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4bc12033-5519-48a6-982e-439d3fe3460e tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] Calling method '.version_select at 0x7f89366753a0>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:20:49.401763 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4bc12033-5519-48a6-982e-439d3fe3460e tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/77bfc232-843f-4280-bd43-e4af694a886f" status: 200 len: 353 microversion: 2.1 time: 0.108005 Sep 13 03:20:49.402442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:20:49 2022] GET /compute/v2.1/os-volumes/77bfc232-843f-4280-bd43-e4af694a886f => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:20:49.416807 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-fa1375d9-22a8-4850-946e-e3ac95b090a6 tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] Calling method '.version_select at 0x7f89366979d0>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:20:49.588647 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-fa1375d9-22a8-4850-946e-e3ac95b090a6 tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/77bfc232-843f-4280-bd43-e4af694a886f" status: 202 len: 0 microversion: 2.1 time: 0.175520 Sep 13 03:20:49.589593 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 3/5] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 03:20:49 2022] DELETE /compute/v2.1/os-volumes/77bfc232-843f-4280-bd43-e4af694a886f => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:20:49.601305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5e3e81ca-d3c0-4fec-882b-9d95926f3ca7 tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] Calling method '.version_select at 0x7f8936675a60>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:20:49.703429 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5e3e81ca-d3c0-4fec-882b-9d95926f3ca7 tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/77bfc232-843f-4280-bd43-e4af694a886f" status: 200 len: 352 microversion: 2.1 time: 0.109919 Sep 13 03:20:49.704525 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 3/6] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:20:49 2022] GET /compute/v2.1/os-volumes/77bfc232-843f-4280-bd43-e4af694a886f => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:20:50.718397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1a6ae63e-38a8-4415-b038-638a36c83169 tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] Calling method '.version_select at 0x7f893662f0d0>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:20:50.801544 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-1a6ae63e-38a8-4415-b038-638a36c83169 tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] HTTP exception thrown: Volume 77bfc232-843f-4280-bd43-e4af694a886f could not be found. Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1a6ae63e-38a8-4415-b038-638a36c83169 tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] Request method failure captured: Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/os-volumes/77bfc232-843f-4280-bd43-e4af694a886f HTTP/1.1 Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cMoSIoRP1_PJrzpWUmv4zl0jQHFVGtjVK7JPxVpeYpp8JhzXimeFY1IrJ9mzroCKG-ADodoI1EtrOv4qaKrhoMCLkZ3rcA6H7SdAoNk85qSvlXX8pr2eSx0PykOAGkArewVlCe_2VBOOt0bIpYJumX529kMpKY0DLhWomV9v59Mi8 Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 9d8c2872e912420696a20ed363471888 Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-VolumesGetTestJSON-1816015828 Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:20:50.807434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:20:50.808850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9d8c2872e912420696a20ed363471888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9d8c2872e912420696a20ed363471888", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d8c2872e912420696a20ed363471888"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9d8c2872e912420696a20ed363471888"}]}] Sep 13 03:20:50.808850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-VolumesGetTestJSON-1816015828 Sep 13 03:20:50.808850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 9d8c2872e912420696a20ed363471888 Sep 13 03:20:50.808850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-VolumesGetTestJSON-1816015828 Sep 13 03:20:50.808850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-VolumesGetTestJSON-1816015828-project Sep 13 03:20:50.808850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:20:50.808850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:20:50.808850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 10ac3e249fb948d6a53010d5accd7097 Sep 13 03:20:50.808850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-VolumesGetTestJSON-1816015828-project Sep 13 03:20:50.808850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: Sep 13 03:20:50.808850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Volume 77bfc232-843f-4280-bd43-e4af694a886f could not be found. Sep 13 03:20:50.808850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': '77bfc232-843f-4280-bd43-e4af694a886f'} Sep 13 03:20:50.808850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77bfc232-843f-4280-bd43-e4af694a886f could not be found. (HTTP 404) (Request-ID: req-476680ab-ac77-4140-b8b2-b6c82f927ff2) Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:50.809793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 03:20:50.811287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77bfc232-843f-4280-bd43-e4af694a886f could not be found. Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 03:20:50.812526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77bfc232-843f-4280-bd43-e4af694a886f could not be found. Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77bfc232-843f-4280-bd43-e4af694a886f could not be found. Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1a6ae63e-38a8-4415-b038-638a36c83169 tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] Returning 404 to user: Volume 77bfc232-843f-4280-bd43-e4af694a886f could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1a6ae63e-38a8-4415-b038-638a36c83169 tempest-VolumesGetTestJSON-1816015828 tempest-VolumesGetTestJSON-1816015828-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/77bfc232-843f-4280-bd43-e4af694a886f" status: 404 len: 109 microversion: 2.1 time: 0.094788 Sep 13 03:20:50.813503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:20:50 2022] GET /compute/v2.1/os-volumes/77bfc232-843f-4280-bd43-e4af694a886f => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:20:54.728027 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2d2fbd6c-b3ef-46c6-a349-38921705e267 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Action: 'create', calling method: .version_select at 0x7f8936675c10>, body: {"keypair": {"name": "tempest-keypair-1907370066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFSftey5kaVSaH1KA7AX4q7aSvsDHhJydgMwEbQv+ioM5buvkhuqgRcEHf2DotVFB01KEL2UR42V0/6lqxpO0rEVD9Y/Ry3/VLtfND0OL7+7Eq86cl6f5QVYv3q7Qj3jg=="}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:20:54.877077 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-2d2fbd6c-b3ef-46c6-a349-38921705e267 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Getting quotas for project 9b7c5a1fd8a24526b7859fdb030ccb95. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:20:54.901092 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-2d2fbd6c-b3ef-46c6-a349-38921705e267 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Getting quotas for user 83bd9ab163ba4229bcfd810345430564 and project 9b7c5a1fd8a24526b7859fdb030ccb95. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:20:55.023411 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2d2fbd6c-b3ef-46c6-a349-38921705e267 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.798191 Sep 13 03:20:55.029144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 4/8] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Sep 13 03:20:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 805 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 03:20:56.608739 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4cca7a46-8d07-419e-ac4f-f81b43f1c5eb tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Action: 'create', calling method: .version_select at 0x7f893662f9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-537089573", "metadata": {"Type": "work"}}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4cca7a46-8d07-419e-ac4f-f81b43f1c5eb tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Request method failure captured: Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 121 Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cYisMN2acE9Ashda0jvIfX_-FpWPIo8-6XVXWSn2XnAL4XnA1dFo8mNQEzoGXNzGthfcpN8aJyakJmMmb9oMfx0pV9l_C8bn2Igf-pcr3dsYlIvNj8QQNlCMFxPes4dntJ8mllmI-eJXZ7cv84fendQFiTVTTvGqD_9He8AWXEDss Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 08cd984973f5443e85cd79d3f0e76834 Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:20:56.614855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:20:56.616024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/08cd984973f5443e85cd79d3f0e76834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_08cd984973f5443e85cd79d3f0e76834", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08cd984973f5443e85cd79d3f0e76834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08cd984973f5443e85cd79d3f0e76834"}]}] Sep 13 03:20:56.616024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.616024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 08cd984973f5443e85cd79d3f0e76834 Sep 13 03:20:56.616024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.616024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-VolumesNegativeTest-2108328742-project Sep 13 03:20:56.616024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:20:56.616024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:20:56.616024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: c11cf177df3d47caafca8b5fe2076778 Sep 13 03:20:56.616024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-VolumesNegativeTest-2108328742-project Sep 13 03:20:56.616024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Sep 13 03:20:56.616024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-537089573", "metadata": {"Type": "work"}}} Sep 13 03:20:56.616024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: Sep 13 03:20:56.616024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-537089573', 'metadata': {'Type': 'work'}}}} Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise error Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:20:56.616832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 03:20:56.617974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 03:20:56.619907 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 03:20:56.619907 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.625111 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4cca7a46-8d07-419e-ac4f-f81b43f1c5eb tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:20:56.628679 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4cca7a46-8d07-419e-ac4f-f81b43f1c5eb tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.371210 Sep 13 03:20:56.633124 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 5/9] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Sep 13 03:20:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 377 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 03:20:56.641310 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1d8accca-c8c9-4cef-a349-9c005164dd49 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Action: 'create', calling method: .version_select at 0x7f8936605160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-760833213", "metadata": {"Type": "work"}}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1d8accca-c8c9-4cef-a349-9c005164dd49 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Request method failure captured: Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 119 Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cYisMN2acE9Ashda0jvIfX_-FpWPIo8-6XVXWSn2XnAL4XnA1dFo8mNQEzoGXNzGthfcpN8aJyakJmMmb9oMfx0pV9l_C8bn2Igf-pcr3dsYlIvNj8QQNlCMFxPes4dntJ8mllmI-eJXZ7cv84fendQFiTVTTvGqD_9He8AWXEDss Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 08cd984973f5443e85cd79d3f0e76834 Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:20:56.657546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:20:56.658586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/08cd984973f5443e85cd79d3f0e76834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_08cd984973f5443e85cd79d3f0e76834", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08cd984973f5443e85cd79d3f0e76834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08cd984973f5443e85cd79d3f0e76834"}]}] Sep 13 03:20:56.658586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.658586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 08cd984973f5443e85cd79d3f0e76834 Sep 13 03:20:56.658586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.658586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-VolumesNegativeTest-2108328742-project Sep 13 03:20:56.658586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:20:56.658586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:20:56.658586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: c11cf177df3d47caafca8b5fe2076778 Sep 13 03:20:56.658586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-VolumesNegativeTest-2108328742-project Sep 13 03:20:56.658586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Sep 13 03:20:56.658586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-760833213", "metadata": {"Type": "work"}}} Sep 13 03:20:56.658586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: Sep 13 03:20:56.658586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-760833213', 'metadata': {'Type': 'work'}}}} Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise error Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi '0' Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:20:56.659377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 03:20:56.660661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 03:20:56.661823 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 03:20:56.661823 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.662784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1d8accca-c8c9-4cef-a349-9c005164dd49 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:20:56.666596 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1d8accca-c8c9-4cef-a349-9c005164dd49 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.030319 Sep 13 03:20:56.671656 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 5/10] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Sep 13 03:20:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 03:20:56.679513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-aaf9ea40-7032-4ac3-87cf-a4dca3abb4e4 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Action: 'create', calling method: .version_select at 0x7f893662f040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-142954219", "metadata": {"Type": "work"}}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-aaf9ea40-7032-4ac3-87cf-a4dca3abb4e4 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Request method failure captured: Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 118 Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cYisMN2acE9Ashda0jvIfX_-FpWPIo8-6XVXWSn2XnAL4XnA1dFo8mNQEzoGXNzGthfcpN8aJyakJmMmb9oMfx0pV9l_C8bn2Igf-pcr3dsYlIvNj8QQNlCMFxPes4dntJ8mllmI-eJXZ7cv84fendQFiTVTTvGqD_9He8AWXEDss Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 08cd984973f5443e85cd79d3f0e76834 Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:20:56.687369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:20:56.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/08cd984973f5443e85cd79d3f0e76834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_08cd984973f5443e85cd79d3f0e76834", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08cd984973f5443e85cd79d3f0e76834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08cd984973f5443e85cd79d3f0e76834"}]}] Sep 13 03:20:56.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 08cd984973f5443e85cd79d3f0e76834 Sep 13 03:20:56.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-VolumesNegativeTest-2108328742-project Sep 13 03:20:56.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:20:56.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:20:56.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: c11cf177df3d47caafca8b5fe2076778 Sep 13 03:20:56.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-VolumesNegativeTest-2108328742-project Sep 13 03:20:56.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Sep 13 03:20:56.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-142954219", "metadata": {"Type": "work"}}} Sep 13 03:20:56.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: Sep 13 03:20:56.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-142954219', 'metadata': {'Type': 'work'}}}} Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise error Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi '' Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:20:56.689852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 03:20:56.691073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 03:20:56.693093 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 03:20:56.693093 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.693093 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-aaf9ea40-7032-4ac3-87cf-a4dca3abb4e4 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:20:56.695637 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-aaf9ea40-7032-4ac3-87cf-a4dca3abb4e4 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017851 Sep 13 03:20:56.697365 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 6/11] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Sep 13 03:20:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 03:20:56.707406 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ff279c79-b7b3-4168-8655-7e23acf206f1 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Calling method '.version_select at 0x7f893656f1f0>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:20:56.782543 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-ff279c79-b7b3-4168-8655-7e23acf206f1 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] HTTP exception thrown: Volume tempest-invalid-478221982 could not be found. Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ff279c79-b7b3-4168-8655-7e23acf206f1 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Request method failure captured: Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-478221982 HTTP/1.1 Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cYisMN2acE9Ashda0jvIfX_-FpWPIo8-6XVXWSn2XnAL4XnA1dFo8mNQEzoGXNzGthfcpN8aJyakJmMmb9oMfx0pV9l_C8bn2Igf-pcr3dsYlIvNj8QQNlCMFxPes4dntJ8mllmI-eJXZ7cv84fendQFiTVTTvGqD_9He8AWXEDss Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 08cd984973f5443e85cd79d3f0e76834 Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:20:56.789640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:20:56.791023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/08cd984973f5443e85cd79d3f0e76834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_08cd984973f5443e85cd79d3f0e76834", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08cd984973f5443e85cd79d3f0e76834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08cd984973f5443e85cd79d3f0e76834"}]}] Sep 13 03:20:56.791023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.791023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 08cd984973f5443e85cd79d3f0e76834 Sep 13 03:20:56.791023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.791023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-VolumesNegativeTest-2108328742-project Sep 13 03:20:56.791023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:20:56.791023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:20:56.791023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: c11cf177df3d47caafca8b5fe2076778 Sep 13 03:20:56.791023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-VolumesNegativeTest-2108328742-project Sep 13 03:20:56.791023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: Sep 13 03:20:56.791023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Volume tempest-invalid-478221982 could not be found. Sep 13 03:20:56.791023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': 'tempest-invalid-478221982'} Sep 13 03:20:56.791023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-478221982 could not be found. (HTTP 404) (Request-ID: req-fe7b7b2d-1058-4aa0-a8ed-754e290a9c8a) Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.791843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 03:20:56.793149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-478221982 could not be found. Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:20:56.794305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-478221982 could not be found. Sep 13 03:20:56.796482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.796482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.796482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.796482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.796482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:56.796482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:56.796482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:20:56.796482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:20:56.796482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-478221982 could not be found. Sep 13 03:20:56.796482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.798363 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ff279c79-b7b3-4168-8655-7e23acf206f1 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Returning 404 to user: Volume tempest-invalid-478221982 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:20:56.800199 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ff279c79-b7b3-4168-8655-7e23acf206f1 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-478221982" status: 404 len: 98 microversion: 2.1 time: 0.097722 Sep 13 03:20:56.801269 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1215 bytes} [Tue Sep 13 03:20:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-478221982 => generated 98 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 03:20:56.810396 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ad3eee47-1a91-4dae-8b16-d112e75500b7 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004115 Sep 13 03:20:56.811691 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Sep 13 03:20:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 13 03:20:56.827491 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d33ddbcc-373a-44ee-82cf-2c80272a238d tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011079 Sep 13 03:20:56.828564 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 7/14] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Sep 13 03:20:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 03:20:56.838206 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-54fc27d0-40b6-40dd-93d4-536247233cba tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Calling method '.version_select at 0x7f8936613f70>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:20:56.895128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-54fc27d0-40b6-40dd-93d4-536247233cba tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] HTTP exception thrown: Volume 54817764-0ebc-48ce-a174-6d5423d54d52 could not be found. Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-54fc27d0-40b6-40dd-93d4-536247233cba tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Request method failure captured: Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: DELETE /compute/v2.1/os-volumes/54817764-0ebc-48ce-a174-6d5423d54d52 HTTP/1.1 Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cYisMN2acE9Ashda0jvIfX_-FpWPIo8-6XVXWSn2XnAL4XnA1dFo8mNQEzoGXNzGthfcpN8aJyakJmMmb9oMfx0pV9l_C8bn2Igf-pcr3dsYlIvNj8QQNlCMFxPes4dntJ8mllmI-eJXZ7cv84fendQFiTVTTvGqD_9He8AWXEDss Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 08cd984973f5443e85cd79d3f0e76834 Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:20:56.897450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:20:56.898985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/08cd984973f5443e85cd79d3f0e76834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_08cd984973f5443e85cd79d3f0e76834", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08cd984973f5443e85cd79d3f0e76834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08cd984973f5443e85cd79d3f0e76834"}]}] Sep 13 03:20:56.898985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.898985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 08cd984973f5443e85cd79d3f0e76834 Sep 13 03:20:56.898985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.898985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-VolumesNegativeTest-2108328742-project Sep 13 03:20:56.898985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:20:56.898985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:20:56.898985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: c11cf177df3d47caafca8b5fe2076778 Sep 13 03:20:56.898985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-VolumesNegativeTest-2108328742-project Sep 13 03:20:56.898985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: Sep 13 03:20:56.898985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Volume 54817764-0ebc-48ce-a174-6d5423d54d52 could not be found. Sep 13 03:20:56.898985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': '54817764-0ebc-48ce-a174-6d5423d54d52'} Sep 13 03:20:56.898985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54817764-0ebc-48ce-a174-6d5423d54d52 could not be found. (HTTP 404) (Request-ID: req-e56079ee-9f60-4ea3-a60e-a8a88dc80d6c) Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.899790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 03:20:56.900910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54817764-0ebc-48ce-a174-6d5423d54d52 could not be found. Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 03:20:56.902006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:20:56.903089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54817764-0ebc-48ce-a174-6d5423d54d52 could not be found. Sep 13 03:20:56.903089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.903089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.903089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.903089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.903089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:56.903089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:56.903089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:20:56.903089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:20:56.903089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54817764-0ebc-48ce-a174-6d5423d54d52 could not be found. Sep 13 03:20:56.903089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.903089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-54fc27d0-40b6-40dd-93d4-536247233cba tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Returning 404 to user: Volume 54817764-0ebc-48ce-a174-6d5423d54d52 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:20:56.904757 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-54fc27d0-40b6-40dd-93d4-536247233cba tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/54817764-0ebc-48ce-a174-6d5423d54d52" status: 404 len: 109 microversion: 2.1 time: 0.071299 Sep 13 03:20:56.905534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 8/15] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 03:20:56 2022] DELETE /compute/v2.1/os-volumes/54817764-0ebc-48ce-a174-6d5423d54d52 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 03:20:56.916333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-034ec062-f1f8-4ea4-a594-011eeac74882 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Calling method '.version_select at 0x7f893656f160>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:20:56.973380 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-034ec062-f1f8-4ea4-a594-011eeac74882 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] HTTP exception thrown: Volume 21e36ca6-075b-4c65-a045-c193fff12c6a could not be found. Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-034ec062-f1f8-4ea4-a594-011eeac74882 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Request method failure captured: Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/os-volumes/21e36ca6-075b-4c65-a045-c193fff12c6a HTTP/1.1 Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cYisMN2acE9Ashda0jvIfX_-FpWPIo8-6XVXWSn2XnAL4XnA1dFo8mNQEzoGXNzGthfcpN8aJyakJmMmb9oMfx0pV9l_C8bn2Igf-pcr3dsYlIvNj8QQNlCMFxPes4dntJ8mllmI-eJXZ7cv84fendQFiTVTTvGqD_9He8AWXEDss Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 08cd984973f5443e85cd79d3f0e76834 Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:20:56.975665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:20:56.976884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/08cd984973f5443e85cd79d3f0e76834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_08cd984973f5443e85cd79d3f0e76834", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08cd984973f5443e85cd79d3f0e76834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/08cd984973f5443e85cd79d3f0e76834"}]}] Sep 13 03:20:56.976884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.976884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 08cd984973f5443e85cd79d3f0e76834 Sep 13 03:20:56.976884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-VolumesNegativeTest-2108328742 Sep 13 03:20:56.976884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-VolumesNegativeTest-2108328742-project Sep 13 03:20:56.976884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:20:56.976884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:20:56.976884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: c11cf177df3d47caafca8b5fe2076778 Sep 13 03:20:56.976884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-VolumesNegativeTest-2108328742-project Sep 13 03:20:56.976884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: Sep 13 03:20:56.976884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Volume 21e36ca6-075b-4c65-a045-c193fff12c6a could not be found. Sep 13 03:20:56.976884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': '21e36ca6-075b-4c65-a045-c193fff12c6a'} Sep 13 03:20:56.976884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 21e36ca6-075b-4c65-a045-c193fff12c6a could not be found. (HTTP 404) (Request-ID: req-1be7bc4c-4f35-439a-a4fe-c39aca418617) Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.977632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 03:20:56.978684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 21e36ca6-075b-4c65-a045-c193fff12c6a could not be found. Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 03:20:56.979737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:20:56.980761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 21e36ca6-075b-4c65-a045-c193fff12c6a could not be found. Sep 13 03:20:56.980761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.980761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:20:56.980761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.980761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:20:56.980761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:20:56.980761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:20:56.980761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:20:56.980761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:20:56.980761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 21e36ca6-075b-4c65-a045-c193fff12c6a could not be found. Sep 13 03:20:56.980761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:20:56.981619 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-034ec062-f1f8-4ea4-a594-011eeac74882 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] Returning 404 to user: Volume 21e36ca6-075b-4c65-a045-c193fff12c6a could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:20:56.982581 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-034ec062-f1f8-4ea4-a594-011eeac74882 tempest-VolumesNegativeTest-2108328742 tempest-VolumesNegativeTest-2108328742-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/21e36ca6-075b-4c65-a045-c193fff12c6a" status: 404 len: 109 microversion: 2.1 time: 0.070416 Sep 13 03:20:56.991726 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:20:56 2022] GET /compute/v2.1/os-volumes/21e36ca6-075b-4c65-a045-c193fff12c6a => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:21:00.632980 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3a8f4ff2-ddda-4264-926b-59e76df8c679 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Action: 'create', calling method: .version_select at 0x7f8936613dc0>, body: {"keypair": {"name": "tempest-keypair-922426083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7MCjPOsi5Hx53l8DmbZzaNvgfceNMTBJ9d7vfpQYiaMyaSziy0dGxoCua/5v3qTX5fikqAewiGHk1VVjj0yTYxb1OzrNWay9iV9A6dXEvAEsQXoZUcnwhjrL5zS1MsOw=="}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:00.765860 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-3a8f4ff2-ddda-4264-926b-59e76df8c679 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Getting quotas for project bb8f67ac0f3c48b2933b6ae34d4fd838. Resources: {'key_pairs'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:21:00.784662 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-3a8f4ff2-ddda-4264-926b-59e76df8c679 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Getting quotas for user 80f6f9a952d84ccab0de028d58aa6914 and project bb8f67ac0f3c48b2933b6ae34d4fd838. Resources: {'key_pairs'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:21:00.932132 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3a8f4ff2-ddda-4264-926b-59e76df8c679 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.534569 Sep 13 03:21:00.933100 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 9/17] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 03:21:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:21:01.738437 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1156506218", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7e1950a0-7f6c-4538-86e4-23311290e33c"}], "security_groups": [{"name": "tempest-securitygroup--1153849667"}], "key_name": "tempest-keypair-1907370066", "user_data": "}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:02.287302 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.network.neutron [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] validate_networks() for [('7e1950a0-7f6c-4538-86e4-23311290e33c', None, None, None, None, None)] {{(pid=120384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:21:04.929373 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=4 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:05.723121 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1634917027", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56b0350b-2f1d-46ac-ad32-a74946bfd610"}], "security_groups": [{"name": "tempest-securitygroup--1648975112"}], "key_name": "tempest-keypair-922426083", "user_data": "}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:06.116155 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.network.neutron [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] validate_networks() for [('56b0350b-2f1d-46ac-ad32-a74946bfd610', None, None, None, None, None)] {{(pid=120383) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:21:07.238466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Flavor limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:21:07.239024 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Image limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:21:07.240031 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Flavor pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:21:07.240414 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Image pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:21:07.240827 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:21:07.260212 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:07.260702 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:07.261134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:07.261852 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:07.262306 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:07.265303 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:07.374250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Getting quotas for project 9b7c5a1fd8a24526b7859fdb030ccb95. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:21:07.383151 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Getting quotas for user 83bd9ab163ba4229bcfd810345430564 and project 9b7c5a1fd8a24526b7859fdb030ccb95. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:21:07.422676 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Going to run 1 instances... {{(pid=120384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:21:07.425420 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:21:07.648251 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-463c1db8-fb0d-4054-8ae3-551a2674532e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.915999 Sep 13 03:21:07.659746 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 9/18] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Sep 13 03:21:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 5928 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 03:21:08.097929 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1988238223", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "networks": [{"uuid": "c32ea5b2-b5dd-443d-b869-2e7693b4d72b"}]}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:08.248017 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.network.neutron [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] validate_networks() for [('c32ea5b2-b5dd-443d-b869-2e7693b4d72b', None, None, None, None, None)] {{(pid=120384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:21:08.280647 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Flavor limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:21:08.281821 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Image limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:21:08.282530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Flavor pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:21:08.283470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Image pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:21:08.284116 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:21:08.304905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:08.305421 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:08.321697 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:08.338577 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:08.339401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:08.340027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:08.402675 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Getting quotas for project bb8f67ac0f3c48b2933b6ae34d4fd838. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:21:08.412006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Getting quotas for user 80f6f9a952d84ccab0de028d58aa6914 and project bb8f67ac0f3c48b2933b6ae34d4fd838. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:21:08.457449 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Going to run 1 instances... {{(pid=120383) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:21:08.462534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:21:08.651219 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9c585137-b1b8-42cf-9b26-9fce962e4873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.934116 Sep 13 03:21:08.652527 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 10/19] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:21:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 2937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:21:08.664538 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ba279733-213a-4717-bca1-2be5ce5f688e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:08.666815 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ba279733-213a-4717-bca1-2be5ce5f688e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:08.972582 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ba279733-213a-4717-bca1-2be5ce5f688e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:09.004896 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ba279733-213a-4717-bca1-2be5ce5f688e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:09.007945 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ba279733-213a-4717-bca1-2be5ce5f688e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:09.009141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ba279733-213a-4717-bca1-2be5ce5f688e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1282 microversion: 2.20 time: 0.355326 Sep 13 03:21:09.012841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:08 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1282 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:09.024813 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9daa0c74-d529-4b5b-ad78-0fb0532b60ec tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:09.025610 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9daa0c74-d529-4b5b-ad78-0fb0532b60ec tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:09.210045 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9daa0c74-d529-4b5b-ad78-0fb0532b60ec tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:09.223180 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9daa0c74-d529-4b5b-ad78-0fb0532b60ec tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1237 microversion: 2.1 time: 0.203908 Sep 13 03:21:09.223885 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 12/21] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:09 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1237 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:09.985840 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Flavor limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:21:09.986388 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Image limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:21:09.987602 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Flavor pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:21:09.989168 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Image pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:21:09.990380 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:21:10.011916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:10.016876 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:10.017578 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:10.021229 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:10.021734 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:10.022156 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:10.060688 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1201161123", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:10.080445 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Getting quotas for project 53d5e604b12545a68da3655cb6b881c5. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:21:10.088904 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Getting quotas for user 616dd34b9fde4ed6b42ec22421ebb504 and project 53d5e604b12545a68da3655cb6b881c5. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:21:10.115331 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Going to run 1 instances... {{(pid=120384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:21:10.127775 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:21:10.179886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.network.neutron [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] validate_networks() for [('cb2e37f0-0a1e-4f79-8597-600d7213f51f', None, None, None, None, None)] {{(pid=120383) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:21:10.280812 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-78a3f602-17ad-4f83-90c2-f5b4ba09f7d9 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.619548 Sep 13 03:21:10.281605 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 10/22] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:21:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:21:10.286832 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ff750e0f-b359-4e7c-aabc-6c809e54bd04 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:10.287443 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ff750e0f-b359-4e7c-aabc-6c809e54bd04 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:10.318220 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ff750e0f-b359-4e7c-aabc-6c809e54bd04 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:10.319820 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ff750e0f-b359-4e7c-aabc-6c809e54bd04 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:10.320267 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ff750e0f-b359-4e7c-aabc-6c809e54bd04 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:10.320982 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ff750e0f-b359-4e7c-aabc-6c809e54bd04 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:10.321442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ff750e0f-b359-4e7c-aabc-6c809e54bd04 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:10.323393 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ff750e0f-b359-4e7c-aabc-6c809e54bd04 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:10.564651 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ff750e0f-b359-4e7c-aabc-6c809e54bd04 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:10.604810 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ff750e0f-b359-4e7c-aabc-6c809e54bd04 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:10.607981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ff750e0f-b359-4e7c-aabc-6c809e54bd04 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:10.609927 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ff750e0f-b359-4e7c-aabc-6c809e54bd04 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1286 microversion: 2.20 time: 0.327379 Sep 13 03:21:10.610489 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 11/23] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:10 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1286 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:10.620183 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f827ab40-3253-4814-b65b-f79c129c2312 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:10.620798 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f827ab40-3253-4814-b65b-f79c129c2312 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:10.736510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f827ab40-3253-4814-b65b-f79c129c2312 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:10.753456 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f827ab40-3253-4814-b65b-f79c129c2312 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1237 microversion: 2.1 time: 0.136801 Sep 13 03:21:10.758391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 12/24] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:10 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1237 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:10.763549 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3db9521e-967e-4e08-8c78-d776b634fe87 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:10.764402 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3db9521e-967e-4e08-8c78-d776b634fe87 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:11.012851 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3db9521e-967e-4e08-8c78-d776b634fe87 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:11.022601 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3db9521e-967e-4e08-8c78-d776b634fe87 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1215 microversion: 2.1 time: 0.260738 Sep 13 03:21:11.038913 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:10 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:11.459585 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c1426b8e-964c-4944-95c5-221008d222f8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'create', calling method: .version_select at 0x7f8935baf670>, body: {"keypair": {"name": "tempest-keypair-901273638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKtKQOmLGlIl52BPQnMY9S6qAxJmvJmpgSVR+jyGxL/sZWswELPqjR60Rd1PhLkjVTAuvoe/yXtTr4G3vi99omDmHeOLBeGAyx3zuzriqKoCOvSmFrOObiQ+0aYR0LuGQ=="}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:11.476887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Flavor limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:21:11.478051 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Image limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:21:11.478781 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Flavor pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:21:11.479449 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Image pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:21:11.481435 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:21:11.493545 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:11.494372 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:11.495251 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:11.496245 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:11.497087 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:11.497806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:11.518652 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Getting quotas for project 609f8dcac1034d09a04192f4238b2857. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:21:11.523673 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Getting quotas for user b85258f01e1f436585eb6b9a4f3813b8 and project 609f8dcac1034d09a04192f4238b2857. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:21:11.536701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Going to run 1 instances... {{(pid=120383) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:21:11.539511 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:21:11.539669 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-c1426b8e-964c-4944-95c5-221008d222f8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:21:11.557615 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-c1426b8e-964c-4944-95c5-221008d222f8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for user 4f76a7c6fe9347b0bea5f701bccb6150 and project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:21:11.602977 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c1426b8e-964c-4944-95c5-221008d222f8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.572927 Sep 13 03:21:11.605664 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 14/26] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 03:21:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:21:11.645650 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-35a87afe-64be-4ac5-a0cf-f74bc9aa7808 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:11.655307 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-35a87afe-64be-4ac5-a0cf-f74bc9aa7808 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:11.683073 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-35a87afe-64be-4ac5-a0cf-f74bc9aa7808 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:11.683982 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-35a87afe-64be-4ac5-a0cf-f74bc9aa7808 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:11.686534 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-35a87afe-64be-4ac5-a0cf-f74bc9aa7808 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:11.691430 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-35a87afe-64be-4ac5-a0cf-f74bc9aa7808 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:11.692394 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-35a87afe-64be-4ac5-a0cf-f74bc9aa7808 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:11.694697 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-35a87afe-64be-4ac5-a0cf-f74bc9aa7808 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:11.764699 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f28feada-2ff7-486c-a612-a1c88802843a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.538157 Sep 13 03:21:11.772583 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 13/27] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:21:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:21:11.792969 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a091d44b-4ad5-44a8-a62f-ea9c97ed3739 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:11.818006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a091d44b-4ad5-44a8-a62f-ea9c97ed3739 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:12.006600 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a091d44b-4ad5-44a8-a62f-ea9c97ed3739 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:12.014031 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a091d44b-4ad5-44a8-a62f-ea9c97ed3739 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1222 microversion: 2.1 time: 0.232621 Sep 13 03:21:12.020132 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 14/28] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:11 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1222 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:12.025705 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-16a221d3-f59f-4f3d-ad94-6f26433e2873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:12.029242 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-35a87afe-64be-4ac5-a0cf-f74bc9aa7808 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:12.035090 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-16a221d3-f59f-4f3d-ad94-6f26433e2873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:12.059205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-16a221d3-f59f-4f3d-ad94-6f26433e2873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:12.061094 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-16a221d3-f59f-4f3d-ad94-6f26433e2873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:12.064088 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-16a221d3-f59f-4f3d-ad94-6f26433e2873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:12.069061 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-16a221d3-f59f-4f3d-ad94-6f26433e2873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:12.070345 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-35a87afe-64be-4ac5-a0cf-f74bc9aa7808 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:12.077330 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-16a221d3-f59f-4f3d-ad94-6f26433e2873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:12.078177 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-16a221d3-f59f-4f3d-ad94-6f26433e2873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:12.081361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-35a87afe-64be-4ac5-a0cf-f74bc9aa7808 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:12.086206 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-35a87afe-64be-4ac5-a0cf-f74bc9aa7808 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1334 microversion: 2.20 time: 0.448481 Sep 13 03:21:12.090184 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 15/29] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:11 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1334 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:12.106383 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0fb569f2-2d5d-4c0c-bd67-c8f4fd5c8365 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:12.108574 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0fb569f2-2d5d-4c0c-bd67-c8f4fd5c8365 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:12.126451 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0fb569f2-2d5d-4c0c-bd67-c8f4fd5c8365 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:12.127002 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0fb569f2-2d5d-4c0c-bd67-c8f4fd5c8365 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:12.130364 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0fb569f2-2d5d-4c0c-bd67-c8f4fd5c8365 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:12.133000 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0fb569f2-2d5d-4c0c-bd67-c8f4fd5c8365 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:12.133495 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0fb569f2-2d5d-4c0c-bd67-c8f4fd5c8365 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:12.135245 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0fb569f2-2d5d-4c0c-bd67-c8f4fd5c8365 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:12.533981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0fb569f2-2d5d-4c0c-bd67-c8f4fd5c8365 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:12.549247 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0fb569f2-2d5d-4c0c-bd67-c8f4fd5c8365 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1211 microversion: 2.1 time: 0.457027 Sep 13 03:21:12.551659 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 16/30] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:12 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1211 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:12.584066 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1416746016", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:12.759941 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.network.neutron [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] validate_networks() for [('cb2e37f0-0a1e-4f79-8597-600d7213f51f', None, None, None, None, None)] {{(pid=120384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:21:12.813524 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-16a221d3-f59f-4f3d-ad94-6f26433e2873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:12.844376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-16a221d3-f59f-4f3d-ad94-6f26433e2873 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1233 microversion: 2.1 time: 0.820075 Sep 13 03:21:12.845000 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 15/31] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:12 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1233 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:13.121144 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-80c2bf9f-253b-4862-8654-7b7999c7fd41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:13.121765 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-80c2bf9f-253b-4862-8654-7b7999c7fd41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:13.137815 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-80c2bf9f-253b-4862-8654-7b7999c7fd41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:13.138369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-80c2bf9f-253b-4862-8654-7b7999c7fd41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:13.138875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-80c2bf9f-253b-4862-8654-7b7999c7fd41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:13.139661 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-80c2bf9f-253b-4862-8654-7b7999c7fd41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:13.140158 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-80c2bf9f-253b-4862-8654-7b7999c7fd41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:13.140640 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-80c2bf9f-253b-4862-8654-7b7999c7fd41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:13.301037 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-80c2bf9f-253b-4862-8654-7b7999c7fd41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:13.310034 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-80c2bf9f-253b-4862-8654-7b7999c7fd41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:13.314975 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-80c2bf9f-253b-4862-8654-7b7999c7fd41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:13.321301 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-80c2bf9f-253b-4862-8654-7b7999c7fd41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1340 microversion: 2.20 time: 0.200533 Sep 13 03:21:13.322073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 16/32] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:13 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1340 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:21:13.575641 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2aa74ee6-33f4-4b41-b2bc-451b3306fef3 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:13.576559 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2aa74ee6-33f4-4b41-b2bc-451b3306fef3 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:13.596320 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2aa74ee6-33f4-4b41-b2bc-451b3306fef3 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:13.597193 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2aa74ee6-33f4-4b41-b2bc-451b3306fef3 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:13.597652 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2aa74ee6-33f4-4b41-b2bc-451b3306fef3 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:13.602398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2aa74ee6-33f4-4b41-b2bc-451b3306fef3 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:13.602917 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2aa74ee6-33f4-4b41-b2bc-451b3306fef3 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:13.605624 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2aa74ee6-33f4-4b41-b2bc-451b3306fef3 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:13.831750 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2aa74ee6-33f4-4b41-b2bc-451b3306fef3 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:13.854328 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2aa74ee6-33f4-4b41-b2bc-451b3306fef3 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1267 microversion: 2.1 time: 0.276982 Sep 13 03:21:13.856556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 17/33] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:13 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:13.872336 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-fe5fd71b-7d63-4827-941a-901d940feaef tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:13.873349 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-fe5fd71b-7d63-4827-941a-901d940feaef tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:13.888243 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fe5fd71b-7d63-4827-941a-901d940feaef tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:13.890265 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fe5fd71b-7d63-4827-941a-901d940feaef tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:13.891415 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fe5fd71b-7d63-4827-941a-901d940feaef tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:13.894431 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fe5fd71b-7d63-4827-941a-901d940feaef tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:13.896037 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fe5fd71b-7d63-4827-941a-901d940feaef tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:13.896694 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fe5fd71b-7d63-4827-941a-901d940feaef tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:14.070213 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-fe5fd71b-7d63-4827-941a-901d940feaef tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:14.080800 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-fe5fd71b-7d63-4827-941a-901d940feaef tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1297 microversion: 2.1 time: 0.212849 Sep 13 03:21:14.099474 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 18/34] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:13 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1297 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:14.353437 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-248bb080-03cc-4c54-b560-9a0190a84963 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:14.354280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-248bb080-03cc-4c54-b560-9a0190a84963 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:14.369251 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-248bb080-03cc-4c54-b560-9a0190a84963 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:14.371087 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-248bb080-03cc-4c54-b560-9a0190a84963 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:14.375767 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-248bb080-03cc-4c54-b560-9a0190a84963 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:14.378008 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-248bb080-03cc-4c54-b560-9a0190a84963 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:14.380527 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-248bb080-03cc-4c54-b560-9a0190a84963 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:14.384047 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-248bb080-03cc-4c54-b560-9a0190a84963 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:14.597724 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-248bb080-03cc-4c54-b560-9a0190a84963 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:14.625307 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-248bb080-03cc-4c54-b560-9a0190a84963 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:14.638690 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-248bb080-03cc-4c54-b560-9a0190a84963 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:14.644850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-248bb080-03cc-4c54-b560-9a0190a84963 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1340 microversion: 2.20 time: 0.298221 Sep 13 03:21:14.648706 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 19/35] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:14 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1340 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:21:14.886344 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2a997608-43ef-4785-a4f4-f500a975a847 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:14.887721 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2a997608-43ef-4785-a4f4-f500a975a847 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:14.896171 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a997608-43ef-4785-a4f4-f500a975a847 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:14.896859 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a997608-43ef-4785-a4f4-f500a975a847 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:14.897459 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a997608-43ef-4785-a4f4-f500a975a847 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:14.901021 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a997608-43ef-4785-a4f4-f500a975a847 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:14.901678 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a997608-43ef-4785-a4f4-f500a975a847 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:14.902269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a997608-43ef-4785-a4f4-f500a975a847 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:15.224998 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2a997608-43ef-4785-a4f4-f500a975a847 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:15.244337 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2a997608-43ef-4785-a4f4-f500a975a847 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1285 microversion: 2.1 time: 0.354371 Sep 13 03:21:15.249566 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 20/36] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:14 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1285 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:15.275169 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ecc6d95f-a8dc-4f96-b396-07f0112a0228 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:15.283630 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ecc6d95f-a8dc-4f96-b396-07f0112a0228 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:15.351724 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ecc6d95f-a8dc-4f96-b396-07f0112a0228 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:15.354555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ecc6d95f-a8dc-4f96-b396-07f0112a0228 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:15.358953 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ecc6d95f-a8dc-4f96-b396-07f0112a0228 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:15.360850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ecc6d95f-a8dc-4f96-b396-07f0112a0228 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:15.363493 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ecc6d95f-a8dc-4f96-b396-07f0112a0228 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:15.371322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ecc6d95f-a8dc-4f96-b396-07f0112a0228 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:16.197284 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ecc6d95f-a8dc-4f96-b396-07f0112a0228 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:16.229286 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ecc6d95f-a8dc-4f96-b396-07f0112a0228 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1295 microversion: 2.1 time: 0.978240 Sep 13 03:21:16.229900 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 21/37] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:15 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1295 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:16.264653 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e17aa8e8-cbae-49be-af63-5b67c2f6d7b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:16.265287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e17aa8e8-cbae-49be-af63-5b67c2f6d7b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:16.328781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Flavor limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:21:16.339306 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Image limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:21:16.341968 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Flavor pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:21:16.342500 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Image pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:21:16.351714 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:21:16.351935 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e17aa8e8-cbae-49be-af63-5b67c2f6d7b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:16.356312 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e17aa8e8-cbae-49be-af63-5b67c2f6d7b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:16.360639 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e17aa8e8-cbae-49be-af63-5b67c2f6d7b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:16.363252 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e17aa8e8-cbae-49be-af63-5b67c2f6d7b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:16.365940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e17aa8e8-cbae-49be-af63-5b67c2f6d7b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:16.368412 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e17aa8e8-cbae-49be-af63-5b67c2f6d7b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:16.418420 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:16.421997 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:16.422461 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:16.423359 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:16.423824 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:16.424263 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:16.501027 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Getting quotas for project 609f8dcac1034d09a04192f4238b2857. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:21:16.525170 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Getting quotas for user b85258f01e1f436585eb6b9a4f3813b8 and project 609f8dcac1034d09a04192f4238b2857. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:21:16.565173 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Going to run 1 instances... {{(pid=120384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:21:16.568443 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:21:16.697118 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3d435476-a81b-44bc-a986-2abdd7c84b6f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.144169 Sep 13 03:21:16.698385 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 17/38] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:21:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 4146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:21:16.703598 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ea220f57-e775-4d57-ab4a-cc206ff49afe tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:16.704478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ea220f57-e775-4d57-ab4a-cc206ff49afe tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:16.710984 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ea220f57-e775-4d57-ab4a-cc206ff49afe tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:16.711752 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ea220f57-e775-4d57-ab4a-cc206ff49afe tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:16.712538 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ea220f57-e775-4d57-ab4a-cc206ff49afe tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:16.713424 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ea220f57-e775-4d57-ab4a-cc206ff49afe tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:16.714077 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ea220f57-e775-4d57-ab4a-cc206ff49afe tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:16.714731 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ea220f57-e775-4d57-ab4a-cc206ff49afe tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:17.233449 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e17aa8e8-cbae-49be-af63-5b67c2f6d7b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:17.256324 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e17aa8e8-cbae-49be-af63-5b67c2f6d7b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:17.266932 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e17aa8e8-cbae-49be-af63-5b67c2f6d7b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:17.269006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e17aa8e8-cbae-49be-af63-5b67c2f6d7b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1340 microversion: 2.20 time: 1.038097 Sep 13 03:21:17.278384 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 22/39] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:16 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1340 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:17.302317 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d99cc123-ac67-4d2e-8593-e2f3a1d2eee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:17.303831 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d99cc123-ac67-4d2e-8593-e2f3a1d2eee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:17.892384 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d99cc123-ac67-4d2e-8593-e2f3a1d2eee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:17.901181 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d99cc123-ac67-4d2e-8593-e2f3a1d2eee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1222 microversion: 2.1 time: 0.621440 Sep 13 03:21:17.923155 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 23/40] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:17 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1222 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:17.943578 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-501b2994-5fc6-4cac-866f-54915a4d3aad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:17.946562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-501b2994-5fc6-4cac-866f-54915a4d3aad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:17.977188 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-501b2994-5fc6-4cac-866f-54915a4d3aad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:17.980967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-501b2994-5fc6-4cac-866f-54915a4d3aad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:17.982795 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-501b2994-5fc6-4cac-866f-54915a4d3aad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:17.987455 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-501b2994-5fc6-4cac-866f-54915a4d3aad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:17.989884 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-501b2994-5fc6-4cac-866f-54915a4d3aad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:17.994991 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-501b2994-5fc6-4cac-866f-54915a4d3aad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:18.493536 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ea220f57-e775-4d57-ab4a-cc206ff49afe tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:18.511001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ea220f57-e775-4d57-ab4a-cc206ff49afe tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1273 microversion: 2.1 time: 1.811201 Sep 13 03:21:18.518512 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 18/41] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:16 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1273 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:18.536772 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2ef222e2-5c04-4df5-9299-ec7871e8b84b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:18.540664 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2ef222e2-5c04-4df5-9299-ec7871e8b84b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:18.551149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=11 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:18.597351 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ef222e2-5c04-4df5-9299-ec7871e8b84b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:18.603822 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ef222e2-5c04-4df5-9299-ec7871e8b84b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:18.610938 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ef222e2-5c04-4df5-9299-ec7871e8b84b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:18.612352 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ef222e2-5c04-4df5-9299-ec7871e8b84b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:18.615214 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ef222e2-5c04-4df5-9299-ec7871e8b84b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:18.616762 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ef222e2-5c04-4df5-9299-ec7871e8b84b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:18.661753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-501b2994-5fc6-4cac-866f-54915a4d3aad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:18.679639 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-501b2994-5fc6-4cac-866f-54915a4d3aad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1295 microversion: 2.1 time: 0.755293 Sep 13 03:21:18.685780 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 24/42] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:17 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1295 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:18.929480 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7dee3d3c-eadd-47ae-a173-ed294dc5da59 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:18.930791 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7dee3d3c-eadd-47ae-a173-ed294dc5da59 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:18.937772 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7dee3d3c-eadd-47ae-a173-ed294dc5da59 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:18.949674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7dee3d3c-eadd-47ae-a173-ed294dc5da59 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:18.951965 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7dee3d3c-eadd-47ae-a173-ed294dc5da59 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:18.956098 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7dee3d3c-eadd-47ae-a173-ed294dc5da59 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:18.959733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7dee3d3c-eadd-47ae-a173-ed294dc5da59 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:18.960951 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7dee3d3c-eadd-47ae-a173-ed294dc5da59 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:19.626989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2ef222e2-5c04-4df5-9299-ec7871e8b84b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:19.638147 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7dee3d3c-eadd-47ae-a173-ed294dc5da59 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:19.643630 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2ef222e2-5c04-4df5-9299-ec7871e8b84b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:19.645804 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2ef222e2-5c04-4df5-9299-ec7871e8b84b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:19.647399 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7dee3d3c-eadd-47ae-a173-ed294dc5da59 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1218 microversion: 2.1 time: 0.721815 Sep 13 03:21:19.648538 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 25/43] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:18 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1218 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:19.648765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2ef222e2-5c04-4df5-9299-ec7871e8b84b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 1.127138 Sep 13 03:21:19.654037 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-00f06ee6-aa6f-4af4-90c5-72b45d360cdd tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:19.654858 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-00f06ee6-aa6f-4af4-90c5-72b45d360cdd tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:19.664233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00f06ee6-aa6f-4af4-90c5-72b45d360cdd tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:19.669964 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00f06ee6-aa6f-4af4-90c5-72b45d360cdd tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:19.670675 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00f06ee6-aa6f-4af4-90c5-72b45d360cdd tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:19.670991 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 19/44] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:18 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:19.671962 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00f06ee6-aa6f-4af4-90c5-72b45d360cdd tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:19.672437 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00f06ee6-aa6f-4af4-90c5-72b45d360cdd tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:19.672867 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00f06ee6-aa6f-4af4-90c5-72b45d360cdd tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:19.721447 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4fad0c0d-dae9-4dc0-81c8-2637903c79ca tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:19.722701 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-4fad0c0d-dae9-4dc0-81c8-2637903c79ca tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:19.743282 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4fad0c0d-dae9-4dc0-81c8-2637903c79ca tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:19.746021 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4fad0c0d-dae9-4dc0-81c8-2637903c79ca tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:19.748837 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4fad0c0d-dae9-4dc0-81c8-2637903c79ca tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:19.750331 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4fad0c0d-dae9-4dc0-81c8-2637903c79ca tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:19.752877 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4fad0c0d-dae9-4dc0-81c8-2637903c79ca tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:19.753726 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4fad0c0d-dae9-4dc0-81c8-2637903c79ca tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:20.014073 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4fad0c0d-dae9-4dc0-81c8-2637903c79ca tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:20.024921 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4fad0c0d-dae9-4dc0-81c8-2637903c79ca tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.309160 Sep 13 03:21:20.025669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-00f06ee6-aa6f-4af4-90c5-72b45d360cdd tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:20.026470 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 20/45] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:19 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:20.049224 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-00f06ee6-aa6f-4af4-90c5-72b45d360cdd tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1273 microversion: 2.1 time: 0.399280 Sep 13 03:21:20.056270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 26/46] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:19 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1273 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:20.564621 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2114676278", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36a6ffba-7b10-4536-9b6f-36478b4a6ccb"}], "security_groups": [{"name": "tempest-securitygroup--924681358"}], "key_name": "tempest-keypair-901273638", "user_data": "}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:20.677443 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-16ba02d3-883d-4959-87aa-7721aad8cca7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:20.678193 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-16ba02d3-883d-4959-87aa-7721aad8cca7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:20.686917 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-16ba02d3-883d-4959-87aa-7721aad8cca7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:20.690417 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-16ba02d3-883d-4959-87aa-7721aad8cca7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:20.695252 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-16ba02d3-883d-4959-87aa-7721aad8cca7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:20.696455 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-16ba02d3-883d-4959-87aa-7721aad8cca7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:20.697141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-16ba02d3-883d-4959-87aa-7721aad8cca7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:20.697789 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-16ba02d3-883d-4959-87aa-7721aad8cca7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:20.858097 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-16ba02d3-883d-4959-87aa-7721aad8cca7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:20.867441 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-16ba02d3-883d-4959-87aa-7721aad8cca7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1218 microversion: 2.1 time: 0.195325 Sep 13 03:21:20.868398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 27/47] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:20 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1218 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:20.873799 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-82d94a84-7da5-4a09-a7bd-e95207c74643 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:20.874820 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-82d94a84-7da5-4a09-a7bd-e95207c74643 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:20.885057 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-82d94a84-7da5-4a09-a7bd-e95207c74643 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:20.888265 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-82d94a84-7da5-4a09-a7bd-e95207c74643 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:20.888823 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-82d94a84-7da5-4a09-a7bd-e95207c74643 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:20.891754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-82d94a84-7da5-4a09-a7bd-e95207c74643 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:20.892902 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-82d94a84-7da5-4a09-a7bd-e95207c74643 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:20.895426 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-82d94a84-7da5-4a09-a7bd-e95207c74643 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:20.924354 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.network.neutron [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] validate_networks() for [('36a6ffba-7b10-4536-9b6f-36478b4a6ccb', None, None, None, None, None)] {{(pid=120384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:21:21.373055 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-82d94a84-7da5-4a09-a7bd-e95207c74643 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:21.381780 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-82d94a84-7da5-4a09-a7bd-e95207c74643 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:21.383679 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-82d94a84-7da5-4a09-a7bd-e95207c74643 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:21.385279 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-82d94a84-7da5-4a09-a7bd-e95207c74643 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.515425 Sep 13 03:21:21.400827 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 28/48] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:20 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:21.412596 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8d6ad761-36cf-48ec-880a-410aba561ed2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:21.413471 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8d6ad761-36cf-48ec-880a-410aba561ed2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:21.421024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8d6ad761-36cf-48ec-880a-410aba561ed2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:21.421597 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8d6ad761-36cf-48ec-880a-410aba561ed2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:21.422266 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8d6ad761-36cf-48ec-880a-410aba561ed2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:21.423221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8d6ad761-36cf-48ec-880a-410aba561ed2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:21.423904 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8d6ad761-36cf-48ec-880a-410aba561ed2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:21.424747 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8d6ad761-36cf-48ec-880a-410aba561ed2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:21.475829 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Flavor limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:21:21.476311 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Image limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:21:21.476792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Flavor pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:21:21.477212 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Image pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:21:21.479676 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:21:21.493221 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:21.493780 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:21.494490 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:21.495555 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:21.496275 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:21.496928 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:21.509420 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=4 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:21.548542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:21:21.554269 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for user 4f76a7c6fe9347b0bea5f701bccb6150 and project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:21:21.573299 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Going to run 1 instances... {{(pid=120384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:21:21.575927 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:21:21.646989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-056adea9-795a-4470-b4a1-c5c0e0c8e831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.086707 Sep 13 03:21:21.656925 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-8d6ad761-36cf-48ec-880a-410aba561ed2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:21.665632 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8d6ad761-36cf-48ec-880a-410aba561ed2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.263274 Sep 13 03:21:21.667391 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 29/49] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:21 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:21.674033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3258b685-263d-4d03-aebc-384509dafd9a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:21.674903 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 21/50] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:21:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:21:21.682965 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3258b685-263d-4d03-aebc-384509dafd9a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:21.685809 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-731908f2-7f69-42f9-a6cc-3e4729c638be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:21.686434 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-731908f2-7f69-42f9-a6cc-3e4729c638be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:21.689394 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3258b685-263d-4d03-aebc-384509dafd9a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:21.689891 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3258b685-263d-4d03-aebc-384509dafd9a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:21.690384 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3258b685-263d-4d03-aebc-384509dafd9a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:21.691125 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3258b685-263d-4d03-aebc-384509dafd9a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:21.691583 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3258b685-263d-4d03-aebc-384509dafd9a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:21.692192 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3258b685-263d-4d03-aebc-384509dafd9a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:21.795489 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-731908f2-7f69-42f9-a6cc-3e4729c638be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:21.805349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-731908f2-7f69-42f9-a6cc-3e4729c638be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1241 microversion: 2.1 time: 0.127660 Sep 13 03:21:21.822636 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 22/51] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:21 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1241 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:21.874281 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3258b685-263d-4d03-aebc-384509dafd9a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:21.884802 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3258b685-263d-4d03-aebc-384509dafd9a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.214848 Sep 13 03:21:21.885697 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 30/52] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:21 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:21.890967 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9319a08f-b454-4bca-923d-179df2f755f8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:21.891529 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9319a08f-b454-4bca-923d-179df2f755f8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:21.909355 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9319a08f-b454-4bca-923d-179df2f755f8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:21.911564 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9319a08f-b454-4bca-923d-179df2f755f8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:21.917978 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9319a08f-b454-4bca-923d-179df2f755f8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:21.919177 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9319a08f-b454-4bca-923d-179df2f755f8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:21.920482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9319a08f-b454-4bca-923d-179df2f755f8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:21.921143 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9319a08f-b454-4bca-923d-179df2f755f8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:22.022505 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9319a08f-b454-4bca-923d-179df2f755f8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:22.032301 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9319a08f-b454-4bca-923d-179df2f755f8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1218 microversion: 2.1 time: 0.144059 Sep 13 03:21:22.034193 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 23/53] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:21 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:22.416707 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5b6eba07-8ad9-4c83-80e8-4cc82fc1fc1c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:22.417320 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5b6eba07-8ad9-4c83-80e8-4cc82fc1fc1c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:22.423708 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5b6eba07-8ad9-4c83-80e8-4cc82fc1fc1c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:22.424219 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5b6eba07-8ad9-4c83-80e8-4cc82fc1fc1c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:22.431378 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5b6eba07-8ad9-4c83-80e8-4cc82fc1fc1c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:22.432272 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5b6eba07-8ad9-4c83-80e8-4cc82fc1fc1c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:22.432910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5b6eba07-8ad9-4c83-80e8-4cc82fc1fc1c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:22.433666 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5b6eba07-8ad9-4c83-80e8-4cc82fc1fc1c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:22.581742 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5b6eba07-8ad9-4c83-80e8-4cc82fc1fc1c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:22.585279 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:22.591057 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5b6eba07-8ad9-4c83-80e8-4cc82fc1fc1c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:22.592597 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5b6eba07-8ad9-4c83-80e8-4cc82fc1fc1c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:22.593695 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5b6eba07-8ad9-4c83-80e8-4cc82fc1fc1c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.180884 Sep 13 03:21:22.594709 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 31/54] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:22 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:22.690423 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e7e6396a-7d62-409c-a970-225345e2c262 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:22.694317 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e7e6396a-7d62-409c-a970-225345e2c262 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:22.701231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e7e6396a-7d62-409c-a970-225345e2c262 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:22.702016 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e7e6396a-7d62-409c-a970-225345e2c262 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:22.702583 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e7e6396a-7d62-409c-a970-225345e2c262 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:22.703764 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e7e6396a-7d62-409c-a970-225345e2c262 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:22.704413 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e7e6396a-7d62-409c-a970-225345e2c262 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:22.705309 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e7e6396a-7d62-409c-a970-225345e2c262 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:22.840097 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d4ec523a-a8f5-4c6b-8343-ad3025b1c5ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:22.844016 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d4ec523a-a8f5-4c6b-8343-ad3025b1c5ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:22.847525 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-e7e6396a-7d62-409c-a970-225345e2c262 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:22.856408 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e7e6396a-7d62-409c-a970-225345e2c262 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.170505 Sep 13 03:21:22.857485 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 24/55] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:22 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:22.858995 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d4ec523a-a8f5-4c6b-8343-ad3025b1c5ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:22.860782 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d4ec523a-a8f5-4c6b-8343-ad3025b1c5ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:22.861233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d4ec523a-a8f5-4c6b-8343-ad3025b1c5ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:22.861951 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d4ec523a-a8f5-4c6b-8343-ad3025b1c5ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:22.862415 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d4ec523a-a8f5-4c6b-8343-ad3025b1c5ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:22.862861 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d4ec523a-a8f5-4c6b-8343-ad3025b1c5ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:22.912246 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-15ba7742-636c-49bd-8ce5-598b675d0b1f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:22.912977 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-15ba7742-636c-49bd-8ce5-598b675d0b1f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:22.936791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-15ba7742-636c-49bd-8ce5-598b675d0b1f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:22.937293 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-15ba7742-636c-49bd-8ce5-598b675d0b1f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:22.937737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-15ba7742-636c-49bd-8ce5-598b675d0b1f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:22.938459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-15ba7742-636c-49bd-8ce5-598b675d0b1f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:22.941802 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-15ba7742-636c-49bd-8ce5-598b675d0b1f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:22.942326 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-15ba7742-636c-49bd-8ce5-598b675d0b1f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:22.977561 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d4ec523a-a8f5-4c6b-8343-ad3025b1c5ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:22.990290 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d4ec523a-a8f5-4c6b-8343-ad3025b1c5ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1245 microversion: 2.1 time: 0.159753 Sep 13 03:21:23.004236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 32/56] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:22 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1245 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:23.057389 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-78da1497-5486-4955-939d-3dd2d1bbf174 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:23.063621 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-78da1497-5486-4955-939d-3dd2d1bbf174 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:23.081876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-78da1497-5486-4955-939d-3dd2d1bbf174 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:23.082379 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-78da1497-5486-4955-939d-3dd2d1bbf174 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:23.083370 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-78da1497-5486-4955-939d-3dd2d1bbf174 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:23.091742 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-78da1497-5486-4955-939d-3dd2d1bbf174 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:23.093036 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-78da1497-5486-4955-939d-3dd2d1bbf174 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:23.093687 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-78da1497-5486-4955-939d-3dd2d1bbf174 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:23.196703 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-78da1497-5486-4955-939d-3dd2d1bbf174 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:23.209195 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-78da1497-5486-4955-939d-3dd2d1bbf174 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1274 microversion: 2.1 time: 0.158236 Sep 13 03:21:23.210117 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 33/57] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:23 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:23.221780 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-15ba7742-636c-49bd-8ce5-598b675d0b1f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:23.233677 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-15ba7742-636c-49bd-8ce5-598b675d0b1f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.323379 Sep 13 03:21:23.246702 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 25/58] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:22 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:23.626104 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-847e580b-4b69-4555-b5a2-3a61555e8f8a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:23.627446 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-847e580b-4b69-4555-b5a2-3a61555e8f8a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:23.634354 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:23.638110 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-847e580b-4b69-4555-b5a2-3a61555e8f8a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:23.638827 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-847e580b-4b69-4555-b5a2-3a61555e8f8a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:23.642978 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-847e580b-4b69-4555-b5a2-3a61555e8f8a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:23.643776 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-847e580b-4b69-4555-b5a2-3a61555e8f8a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:23.644257 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-847e580b-4b69-4555-b5a2-3a61555e8f8a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:23.644882 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-847e580b-4b69-4555-b5a2-3a61555e8f8a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:23.838179 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-847e580b-4b69-4555-b5a2-3a61555e8f8a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:23.847421 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-847e580b-4b69-4555-b5a2-3a61555e8f8a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:23.849100 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-847e580b-4b69-4555-b5a2-3a61555e8f8a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:23.850559 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-847e580b-4b69-4555-b5a2-3a61555e8f8a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.234766 Sep 13 03:21:23.851158 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 34/59] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:23 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:23.886040 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b694bbe7-6c6f-49dc-8cba-4aac0731f756 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:23.886855 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b694bbe7-6c6f-49dc-8cba-4aac0731f756 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:23.896284 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b694bbe7-6c6f-49dc-8cba-4aac0731f756 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:23.896777 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b694bbe7-6c6f-49dc-8cba-4aac0731f756 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:23.897212 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b694bbe7-6c6f-49dc-8cba-4aac0731f756 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:23.897913 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b694bbe7-6c6f-49dc-8cba-4aac0731f756 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:23.898369 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b694bbe7-6c6f-49dc-8cba-4aac0731f756 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:23.899003 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b694bbe7-6c6f-49dc-8cba-4aac0731f756 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:24.030391 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1b87772e-ca07-4fe5-ac2b-1d4ad80a5e90 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:24.031477 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1b87772e-ca07-4fe5-ac2b-1d4ad80a5e90 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:24.038566 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1b87772e-ca07-4fe5-ac2b-1d4ad80a5e90 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:24.039540 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1b87772e-ca07-4fe5-ac2b-1d4ad80a5e90 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:24.040245 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1b87772e-ca07-4fe5-ac2b-1d4ad80a5e90 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:24.041378 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1b87772e-ca07-4fe5-ac2b-1d4ad80a5e90 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:24.042047 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1b87772e-ca07-4fe5-ac2b-1d4ad80a5e90 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:24.042728 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1b87772e-ca07-4fe5-ac2b-1d4ad80a5e90 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:24.090392 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b694bbe7-6c6f-49dc-8cba-4aac0731f756 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:24.132646 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b694bbe7-6c6f-49dc-8cba-4aac0731f756 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.256018 Sep 13 03:21:24.134184 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 26/60] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:23 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:24.156677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1b87772e-ca07-4fe5-ac2b-1d4ad80a5e90 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:24.169902 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1b87772e-ca07-4fe5-ac2b-1d4ad80a5e90 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1245 microversion: 2.1 time: 0.142270 Sep 13 03:21:24.171247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 35/61] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:24 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1245 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:24.239865 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9f7779bd-4bd9-42c1-b643-0f621b264e60 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:24.241427 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9f7779bd-4bd9-42c1-b643-0f621b264e60 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:24.247777 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9f7779bd-4bd9-42c1-b643-0f621b264e60 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:24.249249 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9f7779bd-4bd9-42c1-b643-0f621b264e60 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:24.250323 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9f7779bd-4bd9-42c1-b643-0f621b264e60 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:24.251333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9f7779bd-4bd9-42c1-b643-0f621b264e60 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:24.252007 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9f7779bd-4bd9-42c1-b643-0f621b264e60 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:24.252650 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9f7779bd-4bd9-42c1-b643-0f621b264e60 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:24.262065 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-00604d4d-1228-416a-b13b-4ade87caadcf tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:24.263080 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-00604d4d-1228-416a-b13b-4ade87caadcf tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:24.277388 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00604d4d-1228-416a-b13b-4ade87caadcf tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:24.280151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00604d4d-1228-416a-b13b-4ade87caadcf tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:24.281323 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00604d4d-1228-416a-b13b-4ade87caadcf tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:24.283749 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00604d4d-1228-416a-b13b-4ade87caadcf tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:24.284485 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00604d4d-1228-416a-b13b-4ade87caadcf tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:24.286102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00604d4d-1228-416a-b13b-4ade87caadcf tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:24.439305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9f7779bd-4bd9-42c1-b643-0f621b264e60 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:24.463614 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9f7779bd-4bd9-42c1-b643-0f621b264e60 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1274 microversion: 2.1 time: 0.228917 Sep 13 03:21:24.480343 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 27/62] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:24 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:24.589218 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-00604d4d-1228-416a-b13b-4ade87caadcf tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:24.603692 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-00604d4d-1228-416a-b13b-4ade87caadcf tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.346904 Sep 13 03:21:24.607421 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 36/63] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:24 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:24.876595 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-86fd8343-963b-4c5e-8d6a-030e1d9b5ec1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:24.877214 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-86fd8343-963b-4c5e-8d6a-030e1d9b5ec1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:24.886877 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-86fd8343-963b-4c5e-8d6a-030e1d9b5ec1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:24.887370 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-86fd8343-963b-4c5e-8d6a-030e1d9b5ec1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:24.887810 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-86fd8343-963b-4c5e-8d6a-030e1d9b5ec1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:24.888502 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-86fd8343-963b-4c5e-8d6a-030e1d9b5ec1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:24.888956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-86fd8343-963b-4c5e-8d6a-030e1d9b5ec1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:24.889377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-86fd8343-963b-4c5e-8d6a-030e1d9b5ec1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:25.026138 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-86fd8343-963b-4c5e-8d6a-030e1d9b5ec1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:25.036104 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-86fd8343-963b-4c5e-8d6a-030e1d9b5ec1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:25.037566 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-86fd8343-963b-4c5e-8d6a-030e1d9b5ec1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:25.038706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-86fd8343-963b-4c5e-8d6a-030e1d9b5ec1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.166018 Sep 13 03:21:25.056791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 28/64] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:24 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:25.159619 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1c091a2f-89df-42aa-8eb6-64fc9af6a82b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:25.160319 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1c091a2f-89df-42aa-8eb6-64fc9af6a82b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:25.166974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c091a2f-89df-42aa-8eb6-64fc9af6a82b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:25.167540 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c091a2f-89df-42aa-8eb6-64fc9af6a82b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:25.168057 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c091a2f-89df-42aa-8eb6-64fc9af6a82b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:25.168758 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c091a2f-89df-42aa-8eb6-64fc9af6a82b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:25.169272 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c091a2f-89df-42aa-8eb6-64fc9af6a82b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:25.169634 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c091a2f-89df-42aa-8eb6-64fc9af6a82b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:25.196246 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-92544f68-06cd-4f7d-9c83-992cca54eaae tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:25.196860 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-92544f68-06cd-4f7d-9c83-992cca54eaae tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:25.202841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-92544f68-06cd-4f7d-9c83-992cca54eaae tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:25.203337 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-92544f68-06cd-4f7d-9c83-992cca54eaae tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:25.203776 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-92544f68-06cd-4f7d-9c83-992cca54eaae tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:25.204476 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-92544f68-06cd-4f7d-9c83-992cca54eaae tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:25.205094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-92544f68-06cd-4f7d-9c83-992cca54eaae tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:25.205683 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-92544f68-06cd-4f7d-9c83-992cca54eaae tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:25.270065 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-92544f68-06cd-4f7d-9c83-992cca54eaae tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:25.278549 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-92544f68-06cd-4f7d-9c83-992cca54eaae tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1245 microversion: 2.1 time: 0.086025 Sep 13 03:21:25.279141 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 29/65] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:25 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:25.312642 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1c091a2f-89df-42aa-8eb6-64fc9af6a82b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:25.320384 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1c091a2f-89df-42aa-8eb6-64fc9af6a82b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.164659 Sep 13 03:21:25.320946 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 37/66] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:25 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:25.490808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d2047862-93ea-400e-a9f8-cb753755ad99 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:25.491358 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d2047862-93ea-400e-a9f8-cb753755ad99 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:25.497330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d2047862-93ea-400e-a9f8-cb753755ad99 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:25.497829 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d2047862-93ea-400e-a9f8-cb753755ad99 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:25.498266 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d2047862-93ea-400e-a9f8-cb753755ad99 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:25.498982 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d2047862-93ea-400e-a9f8-cb753755ad99 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:25.499436 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d2047862-93ea-400e-a9f8-cb753755ad99 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:25.499852 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d2047862-93ea-400e-a9f8-cb753755ad99 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:25.562744 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d2047862-93ea-400e-a9f8-cb753755ad99 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:25.572500 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d2047862-93ea-400e-a9f8-cb753755ad99 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1274 microversion: 2.1 time: 0.085557 Sep 13 03:21:25.578692 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 30/67] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:25 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:25.627398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7e722c64-02b1-4339-8049-e5285b042199 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:25.628819 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7e722c64-02b1-4339-8049-e5285b042199 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:25.636407 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7e722c64-02b1-4339-8049-e5285b042199 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:25.636944 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7e722c64-02b1-4339-8049-e5285b042199 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:25.637579 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7e722c64-02b1-4339-8049-e5285b042199 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:25.639065 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7e722c64-02b1-4339-8049-e5285b042199 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:25.639639 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7e722c64-02b1-4339-8049-e5285b042199 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:25.640217 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7e722c64-02b1-4339-8049-e5285b042199 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:25.811443 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7e722c64-02b1-4339-8049-e5285b042199 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:25.820442 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7e722c64-02b1-4339-8049-e5285b042199 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.197675 Sep 13 03:21:25.821011 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 38/68] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:25 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:26.069819 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b72a53ae-f856-478e-aa1b-a69d40c119e9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:26.070383 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b72a53ae-f856-478e-aa1b-a69d40c119e9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:26.085469 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b72a53ae-f856-478e-aa1b-a69d40c119e9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:26.091693 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b72a53ae-f856-478e-aa1b-a69d40c119e9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:26.092183 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b72a53ae-f856-478e-aa1b-a69d40c119e9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:26.092931 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b72a53ae-f856-478e-aa1b-a69d40c119e9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:26.093404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b72a53ae-f856-478e-aa1b-a69d40c119e9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:26.093827 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b72a53ae-f856-478e-aa1b-a69d40c119e9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:26.286285 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b72a53ae-f856-478e-aa1b-a69d40c119e9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:26.296206 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b72a53ae-f856-478e-aa1b-a69d40c119e9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:26.297828 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b72a53ae-f856-478e-aa1b-a69d40c119e9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:26.298873 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b72a53ae-f856-478e-aa1b-a69d40c119e9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.234848 Sep 13 03:21:26.299420 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 31/69] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:26 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:26.306845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-783d9f6f-4456-4b34-a7f4-509763427344 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:26.308648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-783d9f6f-4456-4b34-a7f4-509763427344 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:26.317367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-783d9f6f-4456-4b34-a7f4-509763427344 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:26.318403 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-783d9f6f-4456-4b34-a7f4-509763427344 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:26.319049 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-783d9f6f-4456-4b34-a7f4-509763427344 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:26.319933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-783d9f6f-4456-4b34-a7f4-509763427344 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:26.320543 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-783d9f6f-4456-4b34-a7f4-509763427344 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:26.321310 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-783d9f6f-4456-4b34-a7f4-509763427344 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:26.343576 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-293fb1ab-af5b-41aa-9c24-04f3680caaf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:26.344309 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-293fb1ab-af5b-41aa-9c24-04f3680caaf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:26.351172 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-293fb1ab-af5b-41aa-9c24-04f3680caaf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:26.353574 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-293fb1ab-af5b-41aa-9c24-04f3680caaf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:26.354036 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-293fb1ab-af5b-41aa-9c24-04f3680caaf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:26.354794 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-293fb1ab-af5b-41aa-9c24-04f3680caaf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:26.355265 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-293fb1ab-af5b-41aa-9c24-04f3680caaf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:26.355681 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-293fb1ab-af5b-41aa-9c24-04f3680caaf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:26.360108 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=100 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:26.417576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-783d9f6f-4456-4b34-a7f4-509763427344 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:26.429685 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-783d9f6f-4456-4b34-a7f4-509763427344 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1245 microversion: 2.1 time: 0.131091 Sep 13 03:21:26.430274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 39/70] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:26 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:26.553579 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-293fb1ab-af5b-41aa-9c24-04f3680caaf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:26.567879 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-293fb1ab-af5b-41aa-9c24-04f3680caaf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.228413 Sep 13 03:21:26.568638 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 32/71] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:26 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:26.596671 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-18712187-09a9-4ab0-b67d-8014ef3c0035 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:26.597538 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-18712187-09a9-4ab0-b67d-8014ef3c0035 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:26.611269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18712187-09a9-4ab0-b67d-8014ef3c0035 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:26.611761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18712187-09a9-4ab0-b67d-8014ef3c0035 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:26.612314 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18712187-09a9-4ab0-b67d-8014ef3c0035 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:26.613185 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18712187-09a9-4ab0-b67d-8014ef3c0035 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:26.614351 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18712187-09a9-4ab0-b67d-8014ef3c0035 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:26.614947 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18712187-09a9-4ab0-b67d-8014ef3c0035 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:26.686257 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-18712187-09a9-4ab0-b67d-8014ef3c0035 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:26.693881 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-18712187-09a9-4ab0-b67d-8014ef3c0035 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1274 microversion: 2.1 time: 0.100987 Sep 13 03:21:26.694449 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 40/72] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:26 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:26.843269 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-898bd8cc-bd5f-4293-805f-2eed3d80bcc1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:26.843878 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-898bd8cc-bd5f-4293-805f-2eed3d80bcc1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:26.850168 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-898bd8cc-bd5f-4293-805f-2eed3d80bcc1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:26.850753 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-898bd8cc-bd5f-4293-805f-2eed3d80bcc1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:26.851259 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-898bd8cc-bd5f-4293-805f-2eed3d80bcc1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:26.852068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-898bd8cc-bd5f-4293-805f-2eed3d80bcc1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:26.852765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-898bd8cc-bd5f-4293-805f-2eed3d80bcc1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:26.853240 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-898bd8cc-bd5f-4293-805f-2eed3d80bcc1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:26.988243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-898bd8cc-bd5f-4293-805f-2eed3d80bcc1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:26.995815 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-898bd8cc-bd5f-4293-805f-2eed3d80bcc1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.156381 Sep 13 03:21:26.996372 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 33/73] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:26 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:27.330719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5bc8ba87-bd39-4556-92d5-a77541c96835 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:27.331880 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5bc8ba87-bd39-4556-92d5-a77541c96835 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:27.338978 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5bc8ba87-bd39-4556-92d5-a77541c96835 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:27.339757 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5bc8ba87-bd39-4556-92d5-a77541c96835 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:27.340396 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5bc8ba87-bd39-4556-92d5-a77541c96835 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:27.341260 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5bc8ba87-bd39-4556-92d5-a77541c96835 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:27.341718 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5bc8ba87-bd39-4556-92d5-a77541c96835 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:27.342144 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5bc8ba87-bd39-4556-92d5-a77541c96835 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:27.453463 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-64d51930-ebf8-42d2-a14a-c8f4dc41f03e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:27.454646 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-64d51930-ebf8-42d2-a14a-c8f4dc41f03e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:27.462494 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-64d51930-ebf8-42d2-a14a-c8f4dc41f03e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:27.463110 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-64d51930-ebf8-42d2-a14a-c8f4dc41f03e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:27.463619 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-64d51930-ebf8-42d2-a14a-c8f4dc41f03e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:27.464550 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-64d51930-ebf8-42d2-a14a-c8f4dc41f03e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:27.465214 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-64d51930-ebf8-42d2-a14a-c8f4dc41f03e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:27.465710 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-64d51930-ebf8-42d2-a14a-c8f4dc41f03e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:27.517275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5bc8ba87-bd39-4556-92d5-a77541c96835 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:27.529919 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5bc8ba87-bd39-4556-92d5-a77541c96835 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:27.531755 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5bc8ba87-bd39-4556-92d5-a77541c96835 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:27.532993 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5bc8ba87-bd39-4556-92d5-a77541c96835 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.206994 Sep 13 03:21:27.533548 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 41/74] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:27 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:27.557677 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-64d51930-ebf8-42d2-a14a-c8f4dc41f03e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:27.566678 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-64d51930-ebf8-42d2-a14a-c8f4dc41f03e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1245 microversion: 2.1 time: 0.117206 Sep 13 03:21:27.568542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 34/75] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:27 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:27.591803 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-bef7d8a8-139c-4643-b79a-3742dff32071 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:27.592331 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-bef7d8a8-139c-4643-b79a-3742dff32071 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:27.604576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bef7d8a8-139c-4643-b79a-3742dff32071 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:27.605080 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bef7d8a8-139c-4643-b79a-3742dff32071 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:27.605513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bef7d8a8-139c-4643-b79a-3742dff32071 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:27.606211 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bef7d8a8-139c-4643-b79a-3742dff32071 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:27.606686 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bef7d8a8-139c-4643-b79a-3742dff32071 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:27.607312 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bef7d8a8-139c-4643-b79a-3742dff32071 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:27.718126 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-68538648-44e0-494e-9aa3-ab5cae8fa7eb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:27.719103 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-68538648-44e0-494e-9aa3-ab5cae8fa7eb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:27.727240 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-68538648-44e0-494e-9aa3-ab5cae8fa7eb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:27.730982 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-68538648-44e0-494e-9aa3-ab5cae8fa7eb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:27.731590 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-68538648-44e0-494e-9aa3-ab5cae8fa7eb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:27.735521 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-68538648-44e0-494e-9aa3-ab5cae8fa7eb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:27.736379 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-68538648-44e0-494e-9aa3-ab5cae8fa7eb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:27.738031 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-68538648-44e0-494e-9aa3-ab5cae8fa7eb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:27.765298 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-bef7d8a8-139c-4643-b79a-3742dff32071 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:27.775628 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-bef7d8a8-139c-4643-b79a-3742dff32071 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.187808 Sep 13 03:21:27.779505 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 42/76] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:27 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:27.896182 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-68538648-44e0-494e-9aa3-ab5cae8fa7eb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:27.904328 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-68538648-44e0-494e-9aa3-ab5cae8fa7eb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1274 microversion: 2.1 time: 0.191705 Sep 13 03:21:27.905203 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 35/77] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:27 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:28.018636 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c4ad0394-25a5-48c5-9743-817e99c14be2 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:28.019506 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c4ad0394-25a5-48c5-9743-817e99c14be2 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:28.026322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=24 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:28.034842 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c4ad0394-25a5-48c5-9743-817e99c14be2 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:28.035630 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c4ad0394-25a5-48c5-9743-817e99c14be2 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:28.036219 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c4ad0394-25a5-48c5-9743-817e99c14be2 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:28.037080 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c4ad0394-25a5-48c5-9743-817e99c14be2 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:28.037718 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c4ad0394-25a5-48c5-9743-817e99c14be2 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:28.038318 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c4ad0394-25a5-48c5-9743-817e99c14be2 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:28.279289 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c4ad0394-25a5-48c5-9743-817e99c14be2 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:28.298498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c4ad0394-25a5-48c5-9743-817e99c14be2 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.283531 Sep 13 03:21:28.300072 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 43/78] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:28 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:28.558391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-04038ef1-87e7-4ead-8ede-ea62e89040f7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:28.559055 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-04038ef1-87e7-4ead-8ede-ea62e89040f7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:28.564909 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04038ef1-87e7-4ead-8ede-ea62e89040f7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:28.565388 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04038ef1-87e7-4ead-8ede-ea62e89040f7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:28.565819 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04038ef1-87e7-4ead-8ede-ea62e89040f7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:28.566543 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04038ef1-87e7-4ead-8ede-ea62e89040f7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:28.567603 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04038ef1-87e7-4ead-8ede-ea62e89040f7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:28.568026 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04038ef1-87e7-4ead-8ede-ea62e89040f7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:28.593176 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e395cd17-1765-48fa-ae08-f3cb08a8a793 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:28.593791 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e395cd17-1765-48fa-ae08-f3cb08a8a793 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:28.600326 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e395cd17-1765-48fa-ae08-f3cb08a8a793 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:28.600819 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e395cd17-1765-48fa-ae08-f3cb08a8a793 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:28.601248 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e395cd17-1765-48fa-ae08-f3cb08a8a793 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:28.601936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e395cd17-1765-48fa-ae08-f3cb08a8a793 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:28.602384 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e395cd17-1765-48fa-ae08-f3cb08a8a793 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:28.603012 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e395cd17-1765-48fa-ae08-f3cb08a8a793 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:28.670084 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e395cd17-1765-48fa-ae08-f3cb08a8a793 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:28.679448 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e395cd17-1765-48fa-ae08-f3cb08a8a793 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1245 microversion: 2.1 time: 0.090748 Sep 13 03:21:28.680491 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 44/79] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:28 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:28.739311 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-04038ef1-87e7-4ead-8ede-ea62e89040f7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:28.749762 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-04038ef1-87e7-4ead-8ede-ea62e89040f7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:28.751317 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-04038ef1-87e7-4ead-8ede-ea62e89040f7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:28.752589 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-04038ef1-87e7-4ead-8ede-ea62e89040f7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.198062 Sep 13 03:21:28.753765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 36/80] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:28 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:28.800668 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0327818d-6a78-412b-af02-8c6126de620e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:28.802409 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0327818d-6a78-412b-af02-8c6126de620e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:28.808682 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0327818d-6a78-412b-af02-8c6126de620e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:28.809177 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0327818d-6a78-412b-af02-8c6126de620e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:28.809631 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0327818d-6a78-412b-af02-8c6126de620e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:28.810313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0327818d-6a78-412b-af02-8c6126de620e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:28.810800 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0327818d-6a78-412b-af02-8c6126de620e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:28.811222 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0327818d-6a78-412b-af02-8c6126de620e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:28.929363 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c5fa3deb-a50a-4fa9-b362-32013df8c02e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:28.930161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c5fa3deb-a50a-4fa9-b362-32013df8c02e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:28.936313 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5fa3deb-a50a-4fa9-b362-32013df8c02e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:28.936802 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5fa3deb-a50a-4fa9-b362-32013df8c02e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:28.937239 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5fa3deb-a50a-4fa9-b362-32013df8c02e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:28.937936 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5fa3deb-a50a-4fa9-b362-32013df8c02e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:28.938822 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5fa3deb-a50a-4fa9-b362-32013df8c02e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:28.939257 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5fa3deb-a50a-4fa9-b362-32013df8c02e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:28.945603 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0327818d-6a78-412b-af02-8c6126de620e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:28.953845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0327818d-6a78-412b-af02-8c6126de620e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.157076 Sep 13 03:21:28.954717 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 45/81] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:28 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:29.014522 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c5fa3deb-a50a-4fa9-b362-32013df8c02e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:29.022765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c5fa3deb-a50a-4fa9-b362-32013df8c02e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1274 microversion: 2.1 time: 0.099102 Sep 13 03:21:29.023326 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 37/82] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:28 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:29.324719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-dfe2b92f-2ff4-4e99-afd7-c1d5a9c94389 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:29.325337 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-dfe2b92f-2ff4-4e99-afd7-c1d5a9c94389 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:29.331188 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dfe2b92f-2ff4-4e99-afd7-c1d5a9c94389 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:29.331678 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dfe2b92f-2ff4-4e99-afd7-c1d5a9c94389 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:29.332116 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dfe2b92f-2ff4-4e99-afd7-c1d5a9c94389 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:29.333311 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dfe2b92f-2ff4-4e99-afd7-c1d5a9c94389 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:29.333770 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dfe2b92f-2ff4-4e99-afd7-c1d5a9c94389 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:29.334197 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dfe2b92f-2ff4-4e99-afd7-c1d5a9c94389 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:29.463685 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-dfe2b92f-2ff4-4e99-afd7-c1d5a9c94389 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:29.471611 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-dfe2b92f-2ff4-4e99-afd7-c1d5a9c94389 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.150615 Sep 13 03:21:29.472287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 46/83] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:29 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:29.703285 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0a81b988-1e96-4d4b-af55-359c53976e51 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:29.704505 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0a81b988-1e96-4d4b-af55-359c53976e51 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:29.711320 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a81b988-1e96-4d4b-af55-359c53976e51 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:29.711818 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a81b988-1e96-4d4b-af55-359c53976e51 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:29.712416 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a81b988-1e96-4d4b-af55-359c53976e51 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:29.713300 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a81b988-1e96-4d4b-af55-359c53976e51 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:29.713752 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a81b988-1e96-4d4b-af55-359c53976e51 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:29.714361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a81b988-1e96-4d4b-af55-359c53976e51 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:29.778189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cb0ce5e8-6b4d-4054-88cc-6e5f33ac7756 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:29.778847 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-cb0ce5e8-6b4d-4054-88cc-6e5f33ac7756 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:29.781789 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0a81b988-1e96-4d4b-af55-359c53976e51 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:29.785673 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cb0ce5e8-6b4d-4054-88cc-6e5f33ac7756 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:29.786149 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cb0ce5e8-6b4d-4054-88cc-6e5f33ac7756 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:29.786780 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cb0ce5e8-6b4d-4054-88cc-6e5f33ac7756 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:29.787649 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cb0ce5e8-6b4d-4054-88cc-6e5f33ac7756 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:29.788247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cb0ce5e8-6b4d-4054-88cc-6e5f33ac7756 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:29.788821 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cb0ce5e8-6b4d-4054-88cc-6e5f33ac7756 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:29.789756 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0a81b988-1e96-4d4b-af55-359c53976e51 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1245 microversion: 2.1 time: 0.090571 Sep 13 03:21:29.790322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 38/84] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:29 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:29.940399 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-cb0ce5e8-6b4d-4054-88cc-6e5f33ac7756 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:29.951947 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-cb0ce5e8-6b4d-4054-88cc-6e5f33ac7756 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:29.954129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-cb0ce5e8-6b4d-4054-88cc-6e5f33ac7756 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:29.954129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-cb0ce5e8-6b4d-4054-88cc-6e5f33ac7756 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.180754 Sep 13 03:21:29.975497 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 47/85] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:29 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:21:29.977543 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6ad07c1f-fead-4eb4-96a9-c7a71685da60 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:29.978350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6ad07c1f-fead-4eb4-96a9-c7a71685da60 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:29.996289 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6ad07c1f-fead-4eb4-96a9-c7a71685da60 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:29.997349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6ad07c1f-fead-4eb4-96a9-c7a71685da60 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:29.998700 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6ad07c1f-fead-4eb4-96a9-c7a71685da60 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:29.999625 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6ad07c1f-fead-4eb4-96a9-c7a71685da60 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:30.000243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6ad07c1f-fead-4eb4-96a9-c7a71685da60 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:30.000816 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6ad07c1f-fead-4eb4-96a9-c7a71685da60 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:30.050864 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6cb7d131-603f-4715-af5d-4b2c723d5ee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:30.052264 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6cb7d131-603f-4715-af5d-4b2c723d5ee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:30.059957 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6cb7d131-603f-4715-af5d-4b2c723d5ee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:30.060811 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6cb7d131-603f-4715-af5d-4b2c723d5ee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:30.061478 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6cb7d131-603f-4715-af5d-4b2c723d5ee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:30.062581 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6cb7d131-603f-4715-af5d-4b2c723d5ee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:30.063464 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6cb7d131-603f-4715-af5d-4b2c723d5ee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:30.064125 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6cb7d131-603f-4715-af5d-4b2c723d5ee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:30.094822 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:30.142509 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6cb7d131-603f-4715-af5d-4b2c723d5ee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:30.150454 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6cb7d131-603f-4715-af5d-4b2c723d5ee7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1274 microversion: 2.1 time: 0.108630 Sep 13 03:21:30.151416 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 48/86] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:30 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:30.186479 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-6ad07c1f-fead-4eb4-96a9-c7a71685da60 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:30.196405 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6ad07c1f-fead-4eb4-96a9-c7a71685da60 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.223097 Sep 13 03:21:30.211485 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 39/87] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:29 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:30.494072 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-806d87ec-233d-40b7-ab88-29cc2a76b5df tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:30.494730 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-806d87ec-233d-40b7-ab88-29cc2a76b5df tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:30.501955 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-806d87ec-233d-40b7-ab88-29cc2a76b5df tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:30.502557 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-806d87ec-233d-40b7-ab88-29cc2a76b5df tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:30.503082 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-806d87ec-233d-40b7-ab88-29cc2a76b5df tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:30.503917 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-806d87ec-233d-40b7-ab88-29cc2a76b5df tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:30.504500 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-806d87ec-233d-40b7-ab88-29cc2a76b5df tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:30.505284 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-806d87ec-233d-40b7-ab88-29cc2a76b5df tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:30.664246 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-806d87ec-233d-40b7-ab88-29cc2a76b5df tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:30.672868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-806d87ec-233d-40b7-ab88-29cc2a76b5df tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.182849 Sep 13 03:21:30.673551 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 49/88] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:30 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:30.814260 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ad36fcbb-8c2b-40ca-9718-33eba265a4ff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:30.814919 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ad36fcbb-8c2b-40ca-9718-33eba265a4ff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:30.822001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad36fcbb-8c2b-40ca-9718-33eba265a4ff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:30.822496 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad36fcbb-8c2b-40ca-9718-33eba265a4ff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:30.822961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad36fcbb-8c2b-40ca-9718-33eba265a4ff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:30.823746 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad36fcbb-8c2b-40ca-9718-33eba265a4ff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:30.824229 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad36fcbb-8c2b-40ca-9718-33eba265a4ff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:30.824655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad36fcbb-8c2b-40ca-9718-33eba265a4ff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:30.889573 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ad36fcbb-8c2b-40ca-9718-33eba265a4ff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:30.898311 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ad36fcbb-8c2b-40ca-9718-33eba265a4ff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1245 microversion: 2.1 time: 0.087776 Sep 13 03:21:30.898932 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 40/89] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:30 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:30.985544 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-56f3935d-1ba0-4c5e-b97f-4a41dbc68c36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:30.986157 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-56f3935d-1ba0-4c5e-b97f-4a41dbc68c36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:30.991993 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56f3935d-1ba0-4c5e-b97f-4a41dbc68c36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:30.992484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56f3935d-1ba0-4c5e-b97f-4a41dbc68c36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:30.992924 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56f3935d-1ba0-4c5e-b97f-4a41dbc68c36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:30.993615 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56f3935d-1ba0-4c5e-b97f-4a41dbc68c36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:30.994087 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56f3935d-1ba0-4c5e-b97f-4a41dbc68c36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:30.994510 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56f3935d-1ba0-4c5e-b97f-4a41dbc68c36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:31.166294 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-56f3935d-1ba0-4c5e-b97f-4a41dbc68c36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:31.175583 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5f2b7ad0-123f-4691-83ae-bd64126c4e4f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:31.176608 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5f2b7ad0-123f-4691-83ae-bd64126c4e4f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:31.179023 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-56f3935d-1ba0-4c5e-b97f-4a41dbc68c36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:31.180832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-56f3935d-1ba0-4c5e-b97f-4a41dbc68c36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:31.182564 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-56f3935d-1ba0-4c5e-b97f-4a41dbc68c36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.200488 Sep 13 03:21:31.183232 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 50/90] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:30 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:31.183371 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f2b7ad0-123f-4691-83ae-bd64126c4e4f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:31.183940 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f2b7ad0-123f-4691-83ae-bd64126c4e4f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:31.184601 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f2b7ad0-123f-4691-83ae-bd64126c4e4f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:31.185488 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f2b7ad0-123f-4691-83ae-bd64126c4e4f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:31.186094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f2b7ad0-123f-4691-83ae-bd64126c4e4f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:31.186760 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f2b7ad0-123f-4691-83ae-bd64126c4e4f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:31.219359 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f4724650-9552-4202-8b05-48ce3f269ee6 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:31.219973 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f4724650-9552-4202-8b05-48ce3f269ee6 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:31.226045 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f4724650-9552-4202-8b05-48ce3f269ee6 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:31.226795 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f4724650-9552-4202-8b05-48ce3f269ee6 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:31.227585 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f4724650-9552-4202-8b05-48ce3f269ee6 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:31.228590 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f4724650-9552-4202-8b05-48ce3f269ee6 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:31.229204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f4724650-9552-4202-8b05-48ce3f269ee6 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:31.229776 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f4724650-9552-4202-8b05-48ce3f269ee6 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:31.257384 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5f2b7ad0-123f-4691-83ae-bd64126c4e4f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:31.265787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5f2b7ad0-123f-4691-83ae-bd64126c4e4f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1274 microversion: 2.1 time: 0.096162 Sep 13 03:21:31.267483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 41/91] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:31 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:31.534464 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f4724650-9552-4202-8b05-48ce3f269ee6 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:31.542600 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f4724650-9552-4202-8b05-48ce3f269ee6 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.327137 Sep 13 03:21:31.546809 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 51/92] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:31 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:31.696092 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-55d38595-4c46-4012-8474-a8547245c4ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:31.696757 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-55d38595-4c46-4012-8474-a8547245c4ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:31.698637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=8 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:31.704417 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-55d38595-4c46-4012-8474-a8547245c4ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:31.704903 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-55d38595-4c46-4012-8474-a8547245c4ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:31.705333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-55d38595-4c46-4012-8474-a8547245c4ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:31.706020 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-55d38595-4c46-4012-8474-a8547245c4ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:31.706471 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-55d38595-4c46-4012-8474-a8547245c4ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:31.706916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-55d38595-4c46-4012-8474-a8547245c4ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:31.801787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=34 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:31.869622 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-55d38595-4c46-4012-8474-a8547245c4ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:31.877822 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-55d38595-4c46-4012-8474-a8547245c4ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.185895 Sep 13 03:21:31.883024 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 42/93] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:31 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:31.925438 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-fabcda4c-1425-47d0-b49b-1534df94412b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:31.927097 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-fabcda4c-1425-47d0-b49b-1534df94412b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:31.936197 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fabcda4c-1425-47d0-b49b-1534df94412b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:31.936875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fabcda4c-1425-47d0-b49b-1534df94412b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:31.937420 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fabcda4c-1425-47d0-b49b-1534df94412b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:31.938233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fabcda4c-1425-47d0-b49b-1534df94412b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:31.938938 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fabcda4c-1425-47d0-b49b-1534df94412b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:31.939461 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fabcda4c-1425-47d0-b49b-1534df94412b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:31.997673 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-572701717", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "networks": [{"uuid": "9ed4d27b-3970-4114-ae33-5728b45fb5fc"}]}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:32.013799 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-fabcda4c-1425-47d0-b49b-1534df94412b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:32.022172 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-fabcda4c-1425-47d0-b49b-1534df94412b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1245 microversion: 2.1 time: 0.104370 Sep 13 03:21:32.022752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 52/94] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:31 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:32.070558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.network.neutron [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] validate_networks() for [('9ed4d27b-3970-4114-ae33-5728b45fb5fc', None, None, None, None, None)] {{(pid=120384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:21:32.208185 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-883c703e-388f-40fe-921c-f699197f9146 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:32.208841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-883c703e-388f-40fe-921c-f699197f9146 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:32.215963 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-883c703e-388f-40fe-921c-f699197f9146 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:32.216728 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-883c703e-388f-40fe-921c-f699197f9146 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:32.217321 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-883c703e-388f-40fe-921c-f699197f9146 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:32.219111 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-883c703e-388f-40fe-921c-f699197f9146 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:32.219695 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-883c703e-388f-40fe-921c-f699197f9146 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:32.220245 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-883c703e-388f-40fe-921c-f699197f9146 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:32.425407 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-883c703e-388f-40fe-921c-f699197f9146 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:32.435364 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-883c703e-388f-40fe-921c-f699197f9146 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:32.436856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-883c703e-388f-40fe-921c-f699197f9146 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:32.437967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-883c703e-388f-40fe-921c-f699197f9146 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.233763 Sep 13 03:21:32.438525 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 53/95] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:32 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:21:32.447973 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1c6a0f70-3c42-4481-aa80-0b1f53d185d5 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:32.448752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1c6a0f70-3c42-4481-aa80-0b1f53d185d5 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:32.455637 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c6a0f70-3c42-4481-aa80-0b1f53d185d5 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:32.456419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c6a0f70-3c42-4481-aa80-0b1f53d185d5 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:32.457045 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c6a0f70-3c42-4481-aa80-0b1f53d185d5 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:32.457972 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c6a0f70-3c42-4481-aa80-0b1f53d185d5 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:32.458575 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c6a0f70-3c42-4481-aa80-0b1f53d185d5 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:32.459174 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c6a0f70-3c42-4481-aa80-0b1f53d185d5 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:32.537239 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1c6a0f70-3c42-4481-aa80-0b1f53d185d5 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:32.546444 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1c6a0f70-3c42-4481-aa80-0b1f53d185d5 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1274 microversion: 2.1 time: 0.106306 Sep 13 03:21:32.547682 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 54/96] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:32 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:32.570926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-29b2ae74-177b-40a2-9e1f-f48e94b4c832 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:32.571629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-29b2ae74-177b-40a2-9e1f-f48e94b4c832 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:32.578501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-29b2ae74-177b-40a2-9e1f-f48e94b4c832 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:32.579322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-29b2ae74-177b-40a2-9e1f-f48e94b4c832 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:32.579848 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-29b2ae74-177b-40a2-9e1f-f48e94b4c832 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:32.580624 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-29b2ae74-177b-40a2-9e1f-f48e94b4c832 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:32.581463 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-29b2ae74-177b-40a2-9e1f-f48e94b4c832 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:32.581959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-29b2ae74-177b-40a2-9e1f-f48e94b4c832 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:32.612511 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Flavor limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:21:32.613264 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Image limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:21:32.614603 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Flavor pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:21:32.615251 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Image pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:21:32.615709 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:21:32.625491 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:32.626320 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:32.626765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:32.627675 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:32.628421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:32.628856 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:32.647711 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Getting quotas for project b3ef3a6638114e1f9c838b00285f43f6. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:21:32.652051 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Getting quotas for user 466f990dcac84f4faec701b28616273e and project b3ef3a6638114e1f9c838b00285f43f6. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:21:32.665669 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Going to run 1 instances... {{(pid=120384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:21:32.668759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:21:32.737319 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3b119a26-cc68-4d09-985c-2cc7ed6b2dbc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743979 Sep 13 03:21:32.738159 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 43/97] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:21:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:21:32.750860 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5981285a-abcd-4359-8177-053f978426a8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:32.751635 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5981285a-abcd-4359-8177-053f978426a8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:32.793162 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-29b2ae74-177b-40a2-9e1f-f48e94b4c832 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:32.806456 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-29b2ae74-177b-40a2-9e1f-f48e94b4c832 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.240953 Sep 13 03:21:32.809831 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 55/98] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:32 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:32.824477 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5981285a-abcd-4359-8177-053f978426a8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:32.833296 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5981285a-abcd-4359-8177-053f978426a8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1218 microversion: 2.1 time: 0.086755 Sep 13 03:21:32.849522 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 44/99] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:32 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:32.907884 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a7723791-49db-4e36-bec4-510a80491e6b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:32.908506 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a7723791-49db-4e36-bec4-510a80491e6b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:32.918146 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a7723791-49db-4e36-bec4-510a80491e6b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:32.918600 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a7723791-49db-4e36-bec4-510a80491e6b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:32.919063 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a7723791-49db-4e36-bec4-510a80491e6b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:32.920018 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a7723791-49db-4e36-bec4-510a80491e6b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:32.920468 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a7723791-49db-4e36-bec4-510a80491e6b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:32.921104 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a7723791-49db-4e36-bec4-510a80491e6b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:33.046970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0927ca19-e0d5-4d7c-97df-b0886192aa83 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:33.048168 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0927ca19-e0d5-4d7c-97df-b0886192aa83 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:33.058938 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0927ca19-e0d5-4d7c-97df-b0886192aa83 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:33.064071 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0927ca19-e0d5-4d7c-97df-b0886192aa83 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:33.068849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0927ca19-e0d5-4d7c-97df-b0886192aa83 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:33.069815 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0927ca19-e0d5-4d7c-97df-b0886192aa83 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:33.077467 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0927ca19-e0d5-4d7c-97df-b0886192aa83 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:33.078698 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0927ca19-e0d5-4d7c-97df-b0886192aa83 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:33.090494 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a7723791-49db-4e36-bec4-510a80491e6b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:33.103011 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a7723791-49db-4e36-bec4-510a80491e6b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.199482 Sep 13 03:21:33.104958 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 56/100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:32 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:33.196836 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0927ca19-e0d5-4d7c-97df-b0886192aa83 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:33.207129 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0927ca19-e0d5-4d7c-97df-b0886192aa83 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1237 microversion: 2.1 time: 0.165545 Sep 13 03:21:33.209353 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 45/101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:33 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1237 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:33.472170 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3ff58c72-009c-45d3-b38a-3f4e217a48d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:33.472881 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3ff58c72-009c-45d3-b38a-3f4e217a48d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:33.481426 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ff58c72-009c-45d3-b38a-3f4e217a48d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:33.481910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ff58c72-009c-45d3-b38a-3f4e217a48d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:33.482902 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ff58c72-009c-45d3-b38a-3f4e217a48d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:33.483874 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ff58c72-009c-45d3-b38a-3f4e217a48d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:33.484737 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ff58c72-009c-45d3-b38a-3f4e217a48d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:33.485745 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ff58c72-009c-45d3-b38a-3f4e217a48d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:33.570487 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f0496e42-fc1d-4ba4-a950-a2d4959c96a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:33.571242 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f0496e42-fc1d-4ba4-a950-a2d4959c96a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:33.579477 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f0496e42-fc1d-4ba4-a950-a2d4959c96a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:33.580225 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f0496e42-fc1d-4ba4-a950-a2d4959c96a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:33.581135 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f0496e42-fc1d-4ba4-a950-a2d4959c96a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:33.583242 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f0496e42-fc1d-4ba4-a950-a2d4959c96a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:33.583890 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f0496e42-fc1d-4ba4-a950-a2d4959c96a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:33.584527 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f0496e42-fc1d-4ba4-a950-a2d4959c96a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:33.701472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f0496e42-fc1d-4ba4-a950-a2d4959c96a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:33.712364 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f0496e42-fc1d-4ba4-a950-a2d4959c96a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1274 microversion: 2.1 time: 0.146254 Sep 13 03:21:33.715274 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 46/102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:33 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1274 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:33.841742 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8bed9634-0089-4765-ba2f-813486ec9830 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:33.842869 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8bed9634-0089-4765-ba2f-813486ec9830 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:33.853692 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8bed9634-0089-4765-ba2f-813486ec9830 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:33.854743 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8bed9634-0089-4765-ba2f-813486ec9830 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:33.855597 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8bed9634-0089-4765-ba2f-813486ec9830 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:33.857011 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8bed9634-0089-4765-ba2f-813486ec9830 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:33.857715 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8bed9634-0089-4765-ba2f-813486ec9830 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:33.858350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8bed9634-0089-4765-ba2f-813486ec9830 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:33.949425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3ff58c72-009c-45d3-b38a-3f4e217a48d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:33.957482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3ff58c72-009c-45d3-b38a-3f4e217a48d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:33.959227 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3ff58c72-009c-45d3-b38a-3f4e217a48d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:33.961459 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3ff58c72-009c-45d3-b38a-3f4e217a48d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.494025 Sep 13 03:21:33.962903 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 57/103] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:33 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:33.977275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-371b191f-a4d8-4ccd-8edd-da62b76ce7a0 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:33.981248 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-371b191f-a4d8-4ccd-8edd-da62b76ce7a0 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:33.992410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-371b191f-a4d8-4ccd-8edd-da62b76ce7a0 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:33.992914 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-371b191f-a4d8-4ccd-8edd-da62b76ce7a0 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:33.993353 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-371b191f-a4d8-4ccd-8edd-da62b76ce7a0 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:33.994061 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-371b191f-a4d8-4ccd-8edd-da62b76ce7a0 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:33.994514 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-371b191f-a4d8-4ccd-8edd-da62b76ce7a0 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:33.994958 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-371b191f-a4d8-4ccd-8edd-da62b76ce7a0 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:34.102442 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-371b191f-a4d8-4ccd-8edd-da62b76ce7a0 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:34.118021 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-371b191f-a4d8-4ccd-8edd-da62b76ce7a0 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1222 microversion: 2.1 time: 0.153645 Sep 13 03:21:34.120645 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 58/104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:33 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:34.125946 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3c6a28f6-71c3-4576-84ac-b186fa2e9925 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:34.126748 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3c6a28f6-71c3-4576-84ac-b186fa2e9925 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:34.133003 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3c6a28f6-71c3-4576-84ac-b186fa2e9925 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:34.133653 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3c6a28f6-71c3-4576-84ac-b186fa2e9925 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:34.134844 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3c6a28f6-71c3-4576-84ac-b186fa2e9925 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:34.135275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3c6a28f6-71c3-4576-84ac-b186fa2e9925 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:34.136164 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3c6a28f6-71c3-4576-84ac-b186fa2e9925 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:34.136761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3c6a28f6-71c3-4576-84ac-b186fa2e9925 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:34.523365 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-8bed9634-0089-4765-ba2f-813486ec9830 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:34.531478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8bed9634-0089-4765-ba2f-813486ec9830 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.700222 Sep 13 03:21:34.536232 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 47/105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:33 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:34.546795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3faf14aa-ad06-4cd4-91fe-2c9184c76fb2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:34.547410 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3faf14aa-ad06-4cd4-91fe-2c9184c76fb2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:34.557287 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3faf14aa-ad06-4cd4-91fe-2c9184c76fb2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:34.557785 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3faf14aa-ad06-4cd4-91fe-2c9184c76fb2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:34.563365 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3faf14aa-ad06-4cd4-91fe-2c9184c76fb2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:34.564162 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3faf14aa-ad06-4cd4-91fe-2c9184c76fb2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:34.564793 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3faf14aa-ad06-4cd4-91fe-2c9184c76fb2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:34.565267 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3faf14aa-ad06-4cd4-91fe-2c9184c76fb2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:34.744477 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3faf14aa-ad06-4cd4-91fe-2c9184c76fb2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:34.762759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3faf14aa-ad06-4cd4-91fe-2c9184c76fb2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1293 microversion: 2.1 time: 0.224638 Sep 13 03:21:34.772704 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 48/106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:34 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1293 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:34.791351 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f9b1ee49-b750-4ced-9dcf-5a4358ff8c14 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:34.793163 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f9b1ee49-b750-4ced-9dcf-5a4358ff8c14 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:34.805175 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f9b1ee49-b750-4ced-9dcf-5a4358ff8c14 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:34.805815 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f9b1ee49-b750-4ced-9dcf-5a4358ff8c14 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:34.806769 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f9b1ee49-b750-4ced-9dcf-5a4358ff8c14 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:34.808422 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f9b1ee49-b750-4ced-9dcf-5a4358ff8c14 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:34.809226 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f9b1ee49-b750-4ced-9dcf-5a4358ff8c14 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:34.809706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f9b1ee49-b750-4ced-9dcf-5a4358ff8c14 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:34.919969 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f9b1ee49-b750-4ced-9dcf-5a4358ff8c14 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:34.930827 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f9b1ee49-b750-4ced-9dcf-5a4358ff8c14 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1280 microversion: 2.1 time: 0.156141 Sep 13 03:21:34.934708 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 49/107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:34 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1280 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:34.955425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3c6a28f6-71c3-4576-84ac-b186fa2e9925 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:34.980650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3c6a28f6-71c3-4576-84ac-b186fa2e9925 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.858788 Sep 13 03:21:34.981256 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 59/108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:34 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:35.002141 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8ef9c05f-503e-42b4-8aac-e45fcb5176f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:35.003118 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8ef9c05f-503e-42b4-8aac-e45fcb5176f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:35.012065 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8ef9c05f-503e-42b4-8aac-e45fcb5176f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:35.013931 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8ef9c05f-503e-42b4-8aac-e45fcb5176f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:35.014600 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8ef9c05f-503e-42b4-8aac-e45fcb5176f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:35.015939 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8ef9c05f-503e-42b4-8aac-e45fcb5176f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:35.016613 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8ef9c05f-503e-42b4-8aac-e45fcb5176f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:35.017852 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8ef9c05f-503e-42b4-8aac-e45fcb5176f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:35.046019 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=100 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:35.148812 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d7821236-ca17-4355-a561-828c374885b2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:35.149579 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d7821236-ca17-4355-a561-828c374885b2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:35.160692 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d7821236-ca17-4355-a561-828c374885b2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:35.162193 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d7821236-ca17-4355-a561-828c374885b2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:35.163227 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d7821236-ca17-4355-a561-828c374885b2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:35.164233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d7821236-ca17-4355-a561-828c374885b2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:35.165021 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d7821236-ca17-4355-a561-828c374885b2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:35.165634 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d7821236-ca17-4355-a561-828c374885b2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:35.267525 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d7821236-ca17-4355-a561-828c374885b2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:35.280364 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d7821236-ca17-4355-a561-828c374885b2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1214 microversion: 2.1 time: 0.136275 Sep 13 03:21:35.280965 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 60/109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:35 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:35.297478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-8ef9c05f-503e-42b4-8aac-e45fcb5176f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:35.313505 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-8ef9c05f-503e-42b4-8aac-e45fcb5176f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:35.318278 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-8ef9c05f-503e-42b4-8aac-e45fcb5176f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:35.321990 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8ef9c05f-503e-42b4-8aac-e45fcb5176f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.325266 Sep 13 03:21:35.359307 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 50/110] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:34 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:35.563352 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-449d4946-a642-49aa-bd42-e3b8ec98caea tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:35.563981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-449d4946-a642-49aa-bd42-e3b8ec98caea tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:35.581540 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-449d4946-a642-49aa-bd42-e3b8ec98caea tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:35.582060 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-449d4946-a642-49aa-bd42-e3b8ec98caea tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:35.582569 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-449d4946-a642-49aa-bd42-e3b8ec98caea tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:35.587374 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-449d4946-a642-49aa-bd42-e3b8ec98caea tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:35.591048 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-449d4946-a642-49aa-bd42-e3b8ec98caea tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:35.593301 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-449d4946-a642-49aa-bd42-e3b8ec98caea tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:35.831173 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-05e9eb52-7fc4-4398-b862-85f50e615893 req-f0759242-3362-4f9f-bac0-1ce81af18678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c92a5fc3-da4f-47bf-ab5e-c9c275f38332", "tag": "c44d8cab-cafe-42d0-9df1-25b1e426b401"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:35.866559 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-05e9eb52-7fc4-4398-b862-85f50e615893 req-f0759242-3362-4f9f-bac0-1ce81af18678 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:35.867384 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-05e9eb52-7fc4-4398-b862-85f50e615893 req-f0759242-3362-4f9f-bac0-1ce81af18678 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:35.867885 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-05e9eb52-7fc4-4398-b862-85f50e615893 req-f0759242-3362-4f9f-bac0-1ce81af18678 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:35.908220 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-05e9eb52-7fc4-4398-b862-85f50e615893 req-f0759242-3362-4f9f-bac0-1ce81af18678 service nova] Creating event network-changed:c44d8cab-cafe-42d0-9df1-25b1e426b401 for instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 on hv-cinder-85707 Sep 13 03:21:35.911713 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-05e9eb52-7fc4-4398-b862-85f50e615893 req-f0759242-3362-4f9f-bac0-1ce81af18678 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 03:21:35.913604 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-05e9eb52-7fc4-4398-b862-85f50e615893 req-f0759242-3362-4f9f-bac0-1ce81af18678 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 03:21:35.916642 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50ff9133-742e-47e4-979d-78c7b18aa792 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:35.918646 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50ff9133-742e-47e4-979d-78c7b18aa792 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:35.919211 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50ff9133-742e-47e4-979d-78c7b18aa792 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:35.920227 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50ff9133-742e-47e4-979d-78c7b18aa792 None None] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:35.923413 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50ff9133-742e-47e4-979d-78c7b18aa792 None None] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:35.923893 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50ff9133-742e-47e4-979d-78c7b18aa792 None None] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:35.933831 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.compute.rpcapi [None req-50ff9133-742e-47e4-979d-78c7b18aa792 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 03:21:35.934748 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50ff9133-742e-47e4-979d-78c7b18aa792 None None] Releasing lock "compute-rpcapi-router" {{(pid=120384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 03:21:35.951069 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-50ff9133-742e-47e4-979d-78c7b18aa792 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206764 Sep 13 03:21:35.952171 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 51/111] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:21:35.958101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b79d2af3-5027-4e65-be4f-1c5e8f45475f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:35.958826 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b79d2af3-5027-4e65-be4f-1c5e8f45475f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:35.961736 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:35.965898 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b79d2af3-5027-4e65-be4f-1c5e8f45475f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:35.966384 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b79d2af3-5027-4e65-be4f-1c5e8f45475f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:35.966839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b79d2af3-5027-4e65-be4f-1c5e8f45475f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:35.967529 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b79d2af3-5027-4e65-be4f-1c5e8f45475f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:35.967978 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b79d2af3-5027-4e65-be4f-1c5e8f45475f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:35.968399 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b79d2af3-5027-4e65-be4f-1c5e8f45475f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:36.051912 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b79d2af3-5027-4e65-be4f-1c5e8f45475f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:36.061692 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b79d2af3-5027-4e65-be4f-1c5e8f45475f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1299 microversion: 2.1 time: 0.108272 Sep 13 03:21:36.067881 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 52/112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:35 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:36.073520 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-37521a87-bffe-4a95-af6a-f977c12876b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:36.075232 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-37521a87-bffe-4a95-af6a-f977c12876b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:36.083127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-37521a87-bffe-4a95-af6a-f977c12876b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:36.083921 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-37521a87-bffe-4a95-af6a-f977c12876b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:36.084286 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-37521a87-bffe-4a95-af6a-f977c12876b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:36.085405 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-37521a87-bffe-4a95-af6a-f977c12876b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:36.086382 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-37521a87-bffe-4a95-af6a-f977c12876b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:36.087040 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-37521a87-bffe-4a95-af6a-f977c12876b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:36.186324 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-37521a87-bffe-4a95-af6a-f977c12876b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:36.194993 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-37521a87-bffe-4a95-af6a-f977c12876b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1280 microversion: 2.1 time: 0.125826 Sep 13 03:21:36.195630 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 53/113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:36 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1280 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:36.201121 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5b37d51b-7619-4f08-8f82-d037c359ea2a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:36.201916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5b37d51b-7619-4f08-8f82-d037c359ea2a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:36.209233 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5b37d51b-7619-4f08-8f82-d037c359ea2a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:36.209913 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5b37d51b-7619-4f08-8f82-d037c359ea2a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:36.210765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5b37d51b-7619-4f08-8f82-d037c359ea2a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:36.211664 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5b37d51b-7619-4f08-8f82-d037c359ea2a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:36.212275 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5b37d51b-7619-4f08-8f82-d037c359ea2a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:36.212850 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5b37d51b-7619-4f08-8f82-d037c359ea2a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:36.272206 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-449d4946-a642-49aa-bd42-e3b8ec98caea tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:36.283531 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-449d4946-a642-49aa-bd42-e3b8ec98caea tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.723809 Sep 13 03:21:36.284260 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 61/114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:35 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:36.412565 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-9525f4c6-be44-444b-9ba3-f88a7a98179f req-3bdfb9b1-7be9-4c85-8252-953df1b577bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81", "tag": "5e1eb65a-db49-4f23-a402-182f179922bc"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:36.440771 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-9525f4c6-be44-444b-9ba3-f88a7a98179f req-3bdfb9b1-7be9-4c85-8252-953df1b577bb service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:36.441441 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-9525f4c6-be44-444b-9ba3-f88a7a98179f req-3bdfb9b1-7be9-4c85-8252-953df1b577bb service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:36.442574 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-9525f4c6-be44-444b-9ba3-f88a7a98179f req-3bdfb9b1-7be9-4c85-8252-953df1b577bb service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:36.486748 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-9525f4c6-be44-444b-9ba3-f88a7a98179f req-3bdfb9b1-7be9-4c85-8252-953df1b577bb service nova] Creating event network-changed:5e1eb65a-db49-4f23-a402-182f179922bc for instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 on hv-cinder-85707 Sep 13 03:21:36.487313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-9525f4c6-be44-444b-9ba3-f88a7a98179f req-3bdfb9b1-7be9-4c85-8252-953df1b577bb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120383) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 03:21:36.487771 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-9525f4c6-be44-444b-9ba3-f88a7a98179f req-3bdfb9b1-7be9-4c85-8252-953df1b577bb service nova] Acquired lock "compute-rpcapi-router" {{(pid=120383) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 03:21:36.488884 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-468c5634-182e-4786-a8db-fe49cb92354a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:36.497252 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-468c5634-182e-4786-a8db-fe49cb92354a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:36.497779 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-468c5634-182e-4786-a8db-fe49cb92354a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:36.498684 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-468c5634-182e-4786-a8db-fe49cb92354a None None] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:36.502413 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-468c5634-182e-4786-a8db-fe49cb92354a None None] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:36.507621 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-468c5634-182e-4786-a8db-fe49cb92354a None None] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:36.532158 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.compute.rpcapi [None req-468c5634-182e-4786-a8db-fe49cb92354a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 03:21:36.533079 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-468c5634-182e-4786-a8db-fe49cb92354a None None] Releasing lock "compute-rpcapi-router" {{(pid=120383) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 03:21:36.561848 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-468c5634-182e-4786-a8db-fe49cb92354a None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268166 Sep 13 03:21:36.567698 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 62/115] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:21:36.573289 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-beaac8dd-4424-4669-a7f6-51ef0c5d9fd6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:36.577730 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-beaac8dd-4424-4669-a7f6-51ef0c5d9fd6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:36.592711 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-beaac8dd-4424-4669-a7f6-51ef0c5d9fd6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:36.593223 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-beaac8dd-4424-4669-a7f6-51ef0c5d9fd6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:36.593686 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-beaac8dd-4424-4669-a7f6-51ef0c5d9fd6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:36.594399 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-beaac8dd-4424-4669-a7f6-51ef0c5d9fd6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:36.594881 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-beaac8dd-4424-4669-a7f6-51ef0c5d9fd6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:36.595310 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-beaac8dd-4424-4669-a7f6-51ef0c5d9fd6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:36.677309 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5b37d51b-7619-4f08-8f82-d037c359ea2a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:36.688497 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5b37d51b-7619-4f08-8f82-d037c359ea2a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.491804 Sep 13 03:21:36.693157 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 54/116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:36 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:36.698899 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3644406a-2f32-4952-92f2-3973a90dc940 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:36.699868 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3644406a-2f32-4952-92f2-3973a90dc940 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:36.707145 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3644406a-2f32-4952-92f2-3973a90dc940 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:36.707943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3644406a-2f32-4952-92f2-3973a90dc940 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:36.708843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3644406a-2f32-4952-92f2-3973a90dc940 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:36.709694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3644406a-2f32-4952-92f2-3973a90dc940 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:36.710407 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3644406a-2f32-4952-92f2-3973a90dc940 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:36.711009 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3644406a-2f32-4952-92f2-3973a90dc940 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:36.782025 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-beaac8dd-4424-4669-a7f6-51ef0c5d9fd6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:36.807009 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-beaac8dd-4424-4669-a7f6-51ef0c5d9fd6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1278 microversion: 2.1 time: 0.236976 Sep 13 03:21:36.808094 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 63/117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:36 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1278 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:37.086268 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c6d5ed87-046e-4169-aef4-3aef4c3888ed tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:37.087276 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c6d5ed87-046e-4169-aef4-3aef4c3888ed tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:37.102634 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6d5ed87-046e-4169-aef4-3aef4c3888ed tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:37.105416 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6d5ed87-046e-4169-aef4-3aef4c3888ed tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:37.106215 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6d5ed87-046e-4169-aef4-3aef4c3888ed tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:37.107219 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6d5ed87-046e-4169-aef4-3aef4c3888ed tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:37.107847 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6d5ed87-046e-4169-aef4-3aef4c3888ed tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:37.108367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6d5ed87-046e-4169-aef4-3aef4c3888ed tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:37.275837 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3644406a-2f32-4952-92f2-3973a90dc940 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:37.286878 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3644406a-2f32-4952-92f2-3973a90dc940 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:37.288498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3644406a-2f32-4952-92f2-3973a90dc940 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:37.289844 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3644406a-2f32-4952-92f2-3973a90dc940 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.595609 Sep 13 03:21:37.304662 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c6d5ed87-046e-4169-aef4-3aef4c3888ed tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:37.306111 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 55/118] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:36 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:37.315580 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c5c27d77-bd78-4d4e-b9ae-645ee41d112f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:37.316434 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c5c27d77-bd78-4d4e-b9ae-645ee41d112f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:37.320969 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c6d5ed87-046e-4169-aef4-3aef4c3888ed tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1299 microversion: 2.1 time: 0.236340 Sep 13 03:21:37.322410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 64/119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:37 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1299 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:37.340527 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5c27d77-bd78-4d4e-b9ae-645ee41d112f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:37.341259 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5c27d77-bd78-4d4e-b9ae-645ee41d112f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:37.341901 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5c27d77-bd78-4d4e-b9ae-645ee41d112f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:37.342798 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5c27d77-bd78-4d4e-b9ae-645ee41d112f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:37.343396 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5c27d77-bd78-4d4e-b9ae-645ee41d112f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:37.343995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5c27d77-bd78-4d4e-b9ae-645ee41d112f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:37.345249 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-14b63a4a-3a17-47fe-9e43-b5c7c3d62c09 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:37.346838 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-14b63a4a-3a17-47fe-9e43-b5c7c3d62c09 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:37.363453 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-14b63a4a-3a17-47fe-9e43-b5c7c3d62c09 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:37.365126 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-14b63a4a-3a17-47fe-9e43-b5c7c3d62c09 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:37.365789 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-14b63a4a-3a17-47fe-9e43-b5c7c3d62c09 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:37.367525 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-14b63a4a-3a17-47fe-9e43-b5c7c3d62c09 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:37.368101 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-14b63a4a-3a17-47fe-9e43-b5c7c3d62c09 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:37.368630 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-14b63a4a-3a17-47fe-9e43-b5c7c3d62c09 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:37.395779 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:37.460877 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c5c27d77-bd78-4d4e-b9ae-645ee41d112f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:37.469118 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c5c27d77-bd78-4d4e-b9ae-645ee41d112f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1280 microversion: 2.1 time: 0.161717 Sep 13 03:21:37.470687 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 56/120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:37 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:37.714267 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4ff56d4c-ddaf-497e-b0dd-a8d0a409b02b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:37.714909 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-4ff56d4c-ddaf-497e-b0dd-a8d0a409b02b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:37.720954 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4ff56d4c-ddaf-497e-b0dd-a8d0a409b02b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:37.724356 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4ff56d4c-ddaf-497e-b0dd-a8d0a409b02b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:37.724805 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4ff56d4c-ddaf-497e-b0dd-a8d0a409b02b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:37.725535 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4ff56d4c-ddaf-497e-b0dd-a8d0a409b02b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:37.725989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4ff56d4c-ddaf-497e-b0dd-a8d0a409b02b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:37.726408 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4ff56d4c-ddaf-497e-b0dd-a8d0a409b02b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:38.126311 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-14b63a4a-3a17-47fe-9e43-b5c7c3d62c09 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:38.140746 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-14b63a4a-3a17-47fe-9e43-b5c7c3d62c09 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.816415 Sep 13 03:21:38.142222 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 65/121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:37 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:38.150740 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-123d8fb0-dd36-416b-9126-c9f2171df5f5 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:38.151714 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-123d8fb0-dd36-416b-9126-c9f2171df5f5 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:38.166229 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-123d8fb0-dd36-416b-9126-c9f2171df5f5 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:38.167488 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-123d8fb0-dd36-416b-9126-c9f2171df5f5 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:38.168627 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-123d8fb0-dd36-416b-9126-c9f2171df5f5 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:38.170412 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-123d8fb0-dd36-416b-9126-c9f2171df5f5 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:38.171045 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-123d8fb0-dd36-416b-9126-c9f2171df5f5 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:38.172004 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-123d8fb0-dd36-416b-9126-c9f2171df5f5 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:38.249108 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4ff56d4c-ddaf-497e-b0dd-a8d0a409b02b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:38.266887 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4ff56d4c-ddaf-497e-b0dd-a8d0a409b02b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.555945 Sep 13 03:21:38.282540 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-123d8fb0-dd36-416b-9126-c9f2171df5f5 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:38.283041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 57/122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:37 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:38.288421 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-123d8fb0-dd36-416b-9126-c9f2171df5f5 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1276 microversion: 2.1 time: 0.144129 Sep 13 03:21:38.289593 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-73173ce1-44e3-453b-ace0-f0902266346f req-36c32c5b-51ec-4866-b236-3d6b72a6e595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722dd938-0b13-46d0-9fa1-ff945702438c", "tag": "3183447b-b590-4633-92e3-7d4198ae1660"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:38.292822 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 66/123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:38 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:38.300723 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-73173ce1-44e3-453b-ace0-f0902266346f req-36c32c5b-51ec-4866-b236-3d6b72a6e595 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:38.301955 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-73173ce1-44e3-453b-ace0-f0902266346f req-36c32c5b-51ec-4866-b236-3d6b72a6e595 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:38.302562 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-73173ce1-44e3-453b-ace0-f0902266346f req-36c32c5b-51ec-4866-b236-3d6b72a6e595 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:38.321534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4edb1fb4-b4a9-44a1-8cfd-6d64d64d86f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:38.322236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4edb1fb4-b4a9-44a1-8cfd-6d64d64d86f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:38.330477 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4edb1fb4-b4a9-44a1-8cfd-6d64d64d86f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:38.332981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4edb1fb4-b4a9-44a1-8cfd-6d64d64d86f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:38.336442 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4edb1fb4-b4a9-44a1-8cfd-6d64d64d86f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:38.336762 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-73173ce1-44e3-453b-ace0-f0902266346f req-36c32c5b-51ec-4866-b236-3d6b72a6e595 service nova] Creating event network-changed:3183447b-b590-4633-92e3-7d4198ae1660 for instance 722dd938-0b13-46d0-9fa1-ff945702438c on hv-cinder-85707 Sep 13 03:21:38.340488 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4edb1fb4-b4a9-44a1-8cfd-6d64d64d86f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:38.344319 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4edb1fb4-b4a9-44a1-8cfd-6d64d64d86f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:38.345014 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4edb1fb4-b4a9-44a1-8cfd-6d64d64d86f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:38.349532 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-73173ce1-44e3-453b-ace0-f0902266346f req-36c32c5b-51ec-4866-b236-3d6b72a6e595 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064566 Sep 13 03:21:38.352609 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 58/124] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:21:38.360931 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-dcad1b72-0a98-4752-86d7-a1fde103b048 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:38.364694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-dcad1b72-0a98-4752-86d7-a1fde103b048 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:38.373782 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dcad1b72-0a98-4752-86d7-a1fde103b048 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:38.374365 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dcad1b72-0a98-4752-86d7-a1fde103b048 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:38.374956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dcad1b72-0a98-4752-86d7-a1fde103b048 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:38.375735 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dcad1b72-0a98-4752-86d7-a1fde103b048 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:38.376262 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dcad1b72-0a98-4752-86d7-a1fde103b048 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:38.376814 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dcad1b72-0a98-4752-86d7-a1fde103b048 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:38.513848 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4edb1fb4-b4a9-44a1-8cfd-6d64d64d86f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:38.522148 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4edb1fb4-b4a9-44a1-8cfd-6d64d64d86f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:38.523931 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4edb1fb4-b4a9-44a1-8cfd-6d64d64d86f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:38.525298 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4edb1fb4-b4a9-44a1-8cfd-6d64d64d86f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.207634 Sep 13 03:21:38.539542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 67/125] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:38 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:38.550747 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-383659a9-5b4e-4a4a-a0ec-1e421cc122f3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:38.552271 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-383659a9-5b4e-4a4a-a0ec-1e421cc122f3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:38.558791 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-383659a9-5b4e-4a4a-a0ec-1e421cc122f3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:38.559527 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-383659a9-5b4e-4a4a-a0ec-1e421cc122f3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:38.560153 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-383659a9-5b4e-4a4a-a0ec-1e421cc122f3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:38.561126 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-383659a9-5b4e-4a4a-a0ec-1e421cc122f3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:38.561761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-383659a9-5b4e-4a4a-a0ec-1e421cc122f3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:38.562366 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-383659a9-5b4e-4a4a-a0ec-1e421cc122f3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:38.717940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-383659a9-5b4e-4a4a-a0ec-1e421cc122f3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:38.728910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-383659a9-5b4e-4a4a-a0ec-1e421cc122f3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.187976 Sep 13 03:21:38.729616 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 68/126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:38 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:38.734440 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-e937b2ec-2764-4cd1-88fe-edac3a1250ed req-8dc314a5-7e3d-4382-9e66-be2e44191f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97f011a-6370-474e-9a62-e9229eb7d7ee", "tag": "1c922edb-7dd6-4a91-ba67-004272056f1c"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:38.745873 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-e937b2ec-2764-4cd1-88fe-edac3a1250ed req-8dc314a5-7e3d-4382-9e66-be2e44191f31 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:38.746441 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-e937b2ec-2764-4cd1-88fe-edac3a1250ed req-8dc314a5-7e3d-4382-9e66-be2e44191f31 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:38.746938 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-e937b2ec-2764-4cd1-88fe-edac3a1250ed req-8dc314a5-7e3d-4382-9e66-be2e44191f31 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:38.751812 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-dcad1b72-0a98-4752-86d7-a1fde103b048 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:38.759487 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-e937b2ec-2764-4cd1-88fe-edac3a1250ed req-8dc314a5-7e3d-4382-9e66-be2e44191f31 service nova] Creating event network-changed:1c922edb-7dd6-4a91-ba67-004272056f1c for instance a97f011a-6370-474e-9a62-e9229eb7d7ee on hv-cinder-85707 Sep 13 03:21:38.761244 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-dcad1b72-0a98-4752-86d7-a1fde103b048 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.407276 Sep 13 03:21:38.774637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 59/127] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:38 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:38.775167 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-e937b2ec-2764-4cd1-88fe-edac3a1250ed req-8dc314a5-7e3d-4382-9e66-be2e44191f31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033832 Sep 13 03:21:38.775167 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 69/128] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:21:39.166817 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f10b4097-2041-4bd8-8456-dd28a89db06f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:39.167530 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f10b4097-2041-4bd8-8456-dd28a89db06f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:39.173737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f10b4097-2041-4bd8-8456-dd28a89db06f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:39.174224 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f10b4097-2041-4bd8-8456-dd28a89db06f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:39.174685 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f10b4097-2041-4bd8-8456-dd28a89db06f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:39.175371 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f10b4097-2041-4bd8-8456-dd28a89db06f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:39.175824 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f10b4097-2041-4bd8-8456-dd28a89db06f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:39.176247 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f10b4097-2041-4bd8-8456-dd28a89db06f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:39.290719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-df55f552-41ae-41db-b863-21f3f14254e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:39.291607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-df55f552-41ae-41db-b863-21f3f14254e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:39.298370 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-df55f552-41ae-41db-b863-21f3f14254e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:39.298933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-df55f552-41ae-41db-b863-21f3f14254e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:39.299389 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-df55f552-41ae-41db-b863-21f3f14254e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:39.300080 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-df55f552-41ae-41db-b863-21f3f14254e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:39.300538 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-df55f552-41ae-41db-b863-21f3f14254e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:39.300996 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-df55f552-41ae-41db-b863-21f3f14254e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:39.312246 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f10b4097-2041-4bd8-8456-dd28a89db06f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:39.320840 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f10b4097-2041-4bd8-8456-dd28a89db06f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.157727 Sep 13 03:21:39.321462 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 60/129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:39 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:39.330492 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1fc1c0a7-07d4-485e-b658-0dcdec4f0a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:39.331372 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-1fc1c0a7-07d4-485e-b658-0dcdec4f0a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:39.338696 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1fc1c0a7-07d4-485e-b658-0dcdec4f0a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:39.339194 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1fc1c0a7-07d4-485e-b658-0dcdec4f0a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:39.339638 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1fc1c0a7-07d4-485e-b658-0dcdec4f0a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:39.340373 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1fc1c0a7-07d4-485e-b658-0dcdec4f0a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:39.341428 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1fc1c0a7-07d4-485e-b658-0dcdec4f0a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:39.341860 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1fc1c0a7-07d4-485e-b658-0dcdec4f0a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:39.475774 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-1fc1c0a7-07d4-485e-b658-0dcdec4f0a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:39.483702 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1fc1c0a7-07d4-485e-b658-0dcdec4f0a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.161202 Sep 13 03:21:39.484276 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 61/130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:39 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:39.508681 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-df55f552-41ae-41db-b863-21f3f14254e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:39.516845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-df55f552-41ae-41db-b863-21f3f14254e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.230591 Sep 13 03:21:39.517419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 70/131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:39 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:39.553795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-67c1317d-6a13-40ac-a0e7-8bfb96697068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:39.554409 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-67c1317d-6a13-40ac-a0e7-8bfb96697068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:39.560361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67c1317d-6a13-40ac-a0e7-8bfb96697068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:39.560857 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67c1317d-6a13-40ac-a0e7-8bfb96697068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:39.561294 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67c1317d-6a13-40ac-a0e7-8bfb96697068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:39.561981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67c1317d-6a13-40ac-a0e7-8bfb96697068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:39.562438 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67c1317d-6a13-40ac-a0e7-8bfb96697068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:39.562884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67c1317d-6a13-40ac-a0e7-8bfb96697068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:39.697624 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-67c1317d-6a13-40ac-a0e7-8bfb96697068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:39.706184 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-67c1317d-6a13-40ac-a0e7-8bfb96697068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:39.707687 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-67c1317d-6a13-40ac-a0e7-8bfb96697068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:39.708813 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-67c1317d-6a13-40ac-a0e7-8bfb96697068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.158952 Sep 13 03:21:39.709537 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 62/132] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:39 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:39.752014 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5f8067cb-c7d6-429a-86ea-8cb8b3b1b5ed tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:39.752632 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5f8067cb-c7d6-429a-86ea-8cb8b3b1b5ed tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:39.759057 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5f8067cb-c7d6-429a-86ea-8cb8b3b1b5ed tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:39.759532 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5f8067cb-c7d6-429a-86ea-8cb8b3b1b5ed tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:39.759951 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5f8067cb-c7d6-429a-86ea-8cb8b3b1b5ed tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:39.760635 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5f8067cb-c7d6-429a-86ea-8cb8b3b1b5ed tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:39.761083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5f8067cb-c7d6-429a-86ea-8cb8b3b1b5ed tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:39.761499 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5f8067cb-c7d6-429a-86ea-8cb8b3b1b5ed tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:39.785401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8b2104be-b286-4806-a633-c79b19242a3a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:39.786004 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8b2104be-b286-4806-a633-c79b19242a3a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:39.792361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8b2104be-b286-4806-a633-c79b19242a3a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:39.793209 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8b2104be-b286-4806-a633-c79b19242a3a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:39.793324 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8b2104be-b286-4806-a633-c79b19242a3a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:39.794015 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8b2104be-b286-4806-a633-c79b19242a3a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:39.794462 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8b2104be-b286-4806-a633-c79b19242a3a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:39.795155 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8b2104be-b286-4806-a633-c79b19242a3a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:39.903086 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5f8067cb-c7d6-429a-86ea-8cb8b3b1b5ed tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:39.910893 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5f8067cb-c7d6-429a-86ea-8cb8b3b1b5ed tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.162782 Sep 13 03:21:39.911516 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 71/133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:39 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:39.953216 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-8b2104be-b286-4806-a633-c79b19242a3a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:39.961109 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8b2104be-b286-4806-a633-c79b19242a3a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.179688 Sep 13 03:21:39.961685 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 63/134] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:39 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:40.344360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-24213578-a4d1-417a-8ccd-51403e922750 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:40.344934 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-24213578-a4d1-417a-8ccd-51403e922750 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:40.351355 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-24213578-a4d1-417a-8ccd-51403e922750 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:40.351847 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-24213578-a4d1-417a-8ccd-51403e922750 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:40.352285 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-24213578-a4d1-417a-8ccd-51403e922750 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:40.352974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-24213578-a4d1-417a-8ccd-51403e922750 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:40.353431 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-24213578-a4d1-417a-8ccd-51403e922750 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:40.353854 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-24213578-a4d1-417a-8ccd-51403e922750 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:40.484344 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-24213578-a4d1-417a-8ccd-51403e922750 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:40.491988 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-24213578-a4d1-417a-8ccd-51403e922750 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.151613 Sep 13 03:21:40.492551 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 72/135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:40 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:40.507668 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c60c152e-b25b-4b14-87cf-2ce2fda92d50 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:40.508421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c60c152e-b25b-4b14-87cf-2ce2fda92d50 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:40.517139 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c60c152e-b25b-4b14-87cf-2ce2fda92d50 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:40.517671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c60c152e-b25b-4b14-87cf-2ce2fda92d50 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:40.518100 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c60c152e-b25b-4b14-87cf-2ce2fda92d50 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:40.518827 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c60c152e-b25b-4b14-87cf-2ce2fda92d50 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:40.519275 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c60c152e-b25b-4b14-87cf-2ce2fda92d50 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:40.520213 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c60c152e-b25b-4b14-87cf-2ce2fda92d50 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:40.540414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5a3dc11d-b112-4b8b-9a05-81c6416c8cf1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:40.541243 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5a3dc11d-b112-4b8b-9a05-81c6416c8cf1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:40.547752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5a3dc11d-b112-4b8b-9a05-81c6416c8cf1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:40.548358 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5a3dc11d-b112-4b8b-9a05-81c6416c8cf1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:40.548896 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5a3dc11d-b112-4b8b-9a05-81c6416c8cf1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:40.549688 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5a3dc11d-b112-4b8b-9a05-81c6416c8cf1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:40.552993 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5a3dc11d-b112-4b8b-9a05-81c6416c8cf1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:40.552993 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5a3dc11d-b112-4b8b-9a05-81c6416c8cf1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:40.654428 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c60c152e-b25b-4b14-87cf-2ce2fda92d50 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:40.663255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c60c152e-b25b-4b14-87cf-2ce2fda92d50 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.160200 Sep 13 03:21:40.664086 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 64/136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:40 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:40.710479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5a3dc11d-b112-4b8b-9a05-81c6416c8cf1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:40.718825 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5a3dc11d-b112-4b8b-9a05-81c6416c8cf1 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.182262 Sep 13 03:21:40.719405 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 73/137] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:40 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:40.734143 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2cc016c4-4b8a-4769-8f07-fb33c6249ba8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:40.734864 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2cc016c4-4b8a-4769-8f07-fb33c6249ba8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:40.740701 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2cc016c4-4b8a-4769-8f07-fb33c6249ba8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:40.741189 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2cc016c4-4b8a-4769-8f07-fb33c6249ba8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:40.741618 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2cc016c4-4b8a-4769-8f07-fb33c6249ba8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:40.742304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2cc016c4-4b8a-4769-8f07-fb33c6249ba8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:40.742781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2cc016c4-4b8a-4769-8f07-fb33c6249ba8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:40.743205 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2cc016c4-4b8a-4769-8f07-fb33c6249ba8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:40.876884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2cc016c4-4b8a-4769-8f07-fb33c6249ba8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:40.885257 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2cc016c4-4b8a-4769-8f07-fb33c6249ba8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:40.886728 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2cc016c4-4b8a-4769-8f07-fb33c6249ba8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:40.887830 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2cc016c4-4b8a-4769-8f07-fb33c6249ba8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.158360 Sep 13 03:21:40.888551 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 65/138] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:40 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:21:40.935041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9895b0e6-8d61-4bdb-b96c-d05f4400ceec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:40.935764 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9895b0e6-8d61-4bdb-b96c-d05f4400ceec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:40.942021 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9895b0e6-8d61-4bdb-b96c-d05f4400ceec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:40.942505 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9895b0e6-8d61-4bdb-b96c-d05f4400ceec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:40.942991 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9895b0e6-8d61-4bdb-b96c-d05f4400ceec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:40.943678 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9895b0e6-8d61-4bdb-b96c-d05f4400ceec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:40.944150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9895b0e6-8d61-4bdb-b96c-d05f4400ceec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:40.944793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9895b0e6-8d61-4bdb-b96c-d05f4400ceec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:40.983881 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-81163427-6d97-46ab-9609-a705d72bdfaf tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:40.984541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-81163427-6d97-46ab-9609-a705d72bdfaf tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:40.990474 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81163427-6d97-46ab-9609-a705d72bdfaf tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:40.991001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81163427-6d97-46ab-9609-a705d72bdfaf tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:40.991440 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81163427-6d97-46ab-9609-a705d72bdfaf tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:40.992138 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81163427-6d97-46ab-9609-a705d72bdfaf tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:40.992593 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81163427-6d97-46ab-9609-a705d72bdfaf tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:40.993017 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81163427-6d97-46ab-9609-a705d72bdfaf tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:41.087493 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9895b0e6-8d61-4bdb-b96c-d05f4400ceec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:41.096278 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9895b0e6-8d61-4bdb-b96c-d05f4400ceec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.165003 Sep 13 03:21:41.097030 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 74/139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:40 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:41.140366 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-81163427-6d97-46ab-9609-a705d72bdfaf tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:41.149056 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-81163427-6d97-46ab-9609-a705d72bdfaf tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.168922 Sep 13 03:21:41.149844 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 66/140] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:40 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:41.513957 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f7fad820-ae4c-4381-849f-744bc3a421c2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:41.514781 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f7fad820-ae4c-4381-849f-744bc3a421c2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:41.520715 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f7fad820-ae4c-4381-849f-744bc3a421c2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:41.521360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f7fad820-ae4c-4381-849f-744bc3a421c2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:41.521802 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f7fad820-ae4c-4381-849f-744bc3a421c2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:41.522485 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f7fad820-ae4c-4381-849f-744bc3a421c2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:41.522956 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f7fad820-ae4c-4381-849f-744bc3a421c2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:41.523373 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f7fad820-ae4c-4381-849f-744bc3a421c2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:41.653863 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f7fad820-ae4c-4381-849f-744bc3a421c2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:41.661980 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f7fad820-ae4c-4381-849f-744bc3a421c2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.151813 Sep 13 03:21:41.662813 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 75/141] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:41 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:41.685952 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1d9d7a60-ec52-427e-9554-3d2931e1f499 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:41.686664 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-1d9d7a60-ec52-427e-9554-3d2931e1f499 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:41.692533 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1d9d7a60-ec52-427e-9554-3d2931e1f499 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:41.693175 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1d9d7a60-ec52-427e-9554-3d2931e1f499 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:41.693675 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1d9d7a60-ec52-427e-9554-3d2931e1f499 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:41.694429 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1d9d7a60-ec52-427e-9554-3d2931e1f499 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:41.694990 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1d9d7a60-ec52-427e-9554-3d2931e1f499 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:41.695694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1d9d7a60-ec52-427e-9554-3d2931e1f499 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:41.743298 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f1a9438e-af55-43bd-8308-5d4834c5b232 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:41.744369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f1a9438e-af55-43bd-8308-5d4834c5b232 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:41.752720 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f1a9438e-af55-43bd-8308-5d4834c5b232 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:41.766810 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f1a9438e-af55-43bd-8308-5d4834c5b232 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:41.766810 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f1a9438e-af55-43bd-8308-5d4834c5b232 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:41.766810 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f1a9438e-af55-43bd-8308-5d4834c5b232 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:41.766810 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f1a9438e-af55-43bd-8308-5d4834c5b232 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:41.767222 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f1a9438e-af55-43bd-8308-5d4834c5b232 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:41.842191 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-1d9d7a60-ec52-427e-9554-3d2931e1f499 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:41.850861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1d9d7a60-ec52-427e-9554-3d2931e1f499 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.168572 Sep 13 03:21:41.851420 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 67/142] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:41 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:41.900057 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f1a9438e-af55-43bd-8308-5d4834c5b232 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:41.907845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f1a9438e-af55-43bd-8308-5d4834c5b232 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.170426 Sep 13 03:21:41.908403 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 76/143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:41 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:41.913362 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0a84ae4d-4b52-4316-8e97-646bb2b72b8c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:41.913976 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0a84ae4d-4b52-4316-8e97-646bb2b72b8c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:41.920097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a84ae4d-4b52-4316-8e97-646bb2b72b8c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:41.920579 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a84ae4d-4b52-4316-8e97-646bb2b72b8c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:41.921070 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a84ae4d-4b52-4316-8e97-646bb2b72b8c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:41.921750 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a84ae4d-4b52-4316-8e97-646bb2b72b8c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:41.922199 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a84ae4d-4b52-4316-8e97-646bb2b72b8c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:41.922630 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a84ae4d-4b52-4316-8e97-646bb2b72b8c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:41.926598 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=100 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:42.047857 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0a84ae4d-4b52-4316-8e97-646bb2b72b8c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:42.057410 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0a84ae4d-4b52-4316-8e97-646bb2b72b8c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:42.058956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0a84ae4d-4b52-4316-8e97-646bb2b72b8c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:42.060452 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0a84ae4d-4b52-4316-8e97-646bb2b72b8c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.151615 Sep 13 03:21:42.061432 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 68/144] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:41 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:21:42.118167 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c269d6a8-f40b-4b43-acb9-72da56aecd4b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:42.118869 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c269d6a8-f40b-4b43-acb9-72da56aecd4b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:42.124877 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c269d6a8-f40b-4b43-acb9-72da56aecd4b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:42.125372 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c269d6a8-f40b-4b43-acb9-72da56aecd4b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:42.125805 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c269d6a8-f40b-4b43-acb9-72da56aecd4b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:42.126497 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c269d6a8-f40b-4b43-acb9-72da56aecd4b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:42.126978 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c269d6a8-f40b-4b43-acb9-72da56aecd4b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:42.127403 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c269d6a8-f40b-4b43-acb9-72da56aecd4b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:42.173766 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-bdd1ef82-b223-4d1b-a0e1-1598c8a1053b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:42.177247 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-bdd1ef82-b223-4d1b-a0e1-1598c8a1053b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:42.181371 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bdd1ef82-b223-4d1b-a0e1-1598c8a1053b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:42.181876 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bdd1ef82-b223-4d1b-a0e1-1598c8a1053b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:42.182312 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bdd1ef82-b223-4d1b-a0e1-1598c8a1053b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:42.183065 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bdd1ef82-b223-4d1b-a0e1-1598c8a1053b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:42.183563 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bdd1ef82-b223-4d1b-a0e1-1598c8a1053b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:42.183978 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bdd1ef82-b223-4d1b-a0e1-1598c8a1053b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:42.267233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c269d6a8-f40b-4b43-acb9-72da56aecd4b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:42.276484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c269d6a8-f40b-4b43-acb9-72da56aecd4b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.161938 Sep 13 03:21:42.277291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 77/145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:42 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:42.323150 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-bdd1ef82-b223-4d1b-a0e1-1598c8a1053b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:42.330584 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-bdd1ef82-b223-4d1b-a0e1-1598c8a1053b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.161216 Sep 13 03:21:42.331167 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 69/146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:42 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:42.685203 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-199a1957-0957-43c9-89b9-608ddf778725 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:42.685869 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-199a1957-0957-43c9-89b9-608ddf778725 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:42.692157 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-199a1957-0957-43c9-89b9-608ddf778725 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:42.692639 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-199a1957-0957-43c9-89b9-608ddf778725 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:42.693070 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-199a1957-0957-43c9-89b9-608ddf778725 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:42.693757 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-199a1957-0957-43c9-89b9-608ddf778725 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:42.694235 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-199a1957-0957-43c9-89b9-608ddf778725 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:42.694680 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-199a1957-0957-43c9-89b9-608ddf778725 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:42.831631 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-199a1957-0957-43c9-89b9-608ddf778725 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:42.839569 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-199a1957-0957-43c9-89b9-608ddf778725 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.158135 Sep 13 03:21:42.840219 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 78/147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:42 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:42.873108 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c6565f97-77c9-4989-9250-256f9775b3f4 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:42.873715 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c6565f97-77c9-4989-9250-256f9775b3f4 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:42.876842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=8 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:42.881636 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c6565f97-77c9-4989-9250-256f9775b3f4 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:42.882119 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c6565f97-77c9-4989-9250-256f9775b3f4 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:42.882552 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c6565f97-77c9-4989-9250-256f9775b3f4 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:42.883296 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c6565f97-77c9-4989-9250-256f9775b3f4 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:42.883750 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c6565f97-77c9-4989-9250-256f9775b3f4 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:42.884169 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c6565f97-77c9-4989-9250-256f9775b3f4 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:42.932836 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a32a7323-1dab-4d11-812c-e66333d3a5a6 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:42.933521 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a32a7323-1dab-4d11-812c-e66333d3a5a6 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:42.939908 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a32a7323-1dab-4d11-812c-e66333d3a5a6 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:42.940417 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a32a7323-1dab-4d11-812c-e66333d3a5a6 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:42.940881 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a32a7323-1dab-4d11-812c-e66333d3a5a6 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:42.942164 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a32a7323-1dab-4d11-812c-e66333d3a5a6 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:42.942700 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a32a7323-1dab-4d11-812c-e66333d3a5a6 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:42.943224 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a32a7323-1dab-4d11-812c-e66333d3a5a6 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:43.027285 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c6565f97-77c9-4989-9250-256f9775b3f4 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:43.036411 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c6565f97-77c9-4989-9250-256f9775b3f4 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.166934 Sep 13 03:21:43.037289 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 70/148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:42 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:43.085550 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-eda9ed04-5968-496f-8f4f-a6259c38876a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:43.086268 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-eda9ed04-5968-496f-8f4f-a6259c38876a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:43.087686 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a32a7323-1dab-4d11-812c-e66333d3a5a6 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:43.092912 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-eda9ed04-5968-496f-8f4f-a6259c38876a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:43.093504 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-eda9ed04-5968-496f-8f4f-a6259c38876a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:43.094039 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-eda9ed04-5968-496f-8f4f-a6259c38876a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:43.094863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-eda9ed04-5968-496f-8f4f-a6259c38876a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:43.095428 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-eda9ed04-5968-496f-8f4f-a6259c38876a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:43.095657 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a32a7323-1dab-4d11-812c-e66333d3a5a6 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.167131 Sep 13 03:21:43.096047 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-eda9ed04-5968-496f-8f4f-a6259c38876a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:43.098688 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 79/149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:42 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:43.225706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-eda9ed04-5968-496f-8f4f-a6259c38876a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:43.233651 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-eda9ed04-5968-496f-8f4f-a6259c38876a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:43.235231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-eda9ed04-5968-496f-8f4f-a6259c38876a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:43.236560 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-eda9ed04-5968-496f-8f4f-a6259c38876a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.154954 Sep 13 03:21:43.237143 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 71/150] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:43 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:21:43.299224 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6af73f31-cb76-4dbc-b895-664d86e78cfa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:43.299858 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6af73f31-cb76-4dbc-b895-664d86e78cfa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:43.306271 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6af73f31-cb76-4dbc-b895-664d86e78cfa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:43.306787 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6af73f31-cb76-4dbc-b895-664d86e78cfa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:43.307222 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6af73f31-cb76-4dbc-b895-664d86e78cfa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:43.307898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6af73f31-cb76-4dbc-b895-664d86e78cfa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:43.308345 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6af73f31-cb76-4dbc-b895-664d86e78cfa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:43.308941 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6af73f31-cb76-4dbc-b895-664d86e78cfa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:43.354051 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ad5ebe5c-218b-4640-81f6-f20b4a5854f1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:43.355646 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ad5ebe5c-218b-4640-81f6-f20b4a5854f1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:43.361961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad5ebe5c-218b-4640-81f6-f20b4a5854f1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:43.362692 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad5ebe5c-218b-4640-81f6-f20b4a5854f1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:43.363284 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad5ebe5c-218b-4640-81f6-f20b4a5854f1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:43.364280 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad5ebe5c-218b-4640-81f6-f20b4a5854f1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:43.364736 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad5ebe5c-218b-4640-81f6-f20b4a5854f1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:43.365621 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad5ebe5c-218b-4640-81f6-f20b4a5854f1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:43.451588 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6af73f31-cb76-4dbc-b895-664d86e78cfa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:43.460284 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6af73f31-cb76-4dbc-b895-664d86e78cfa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.164874 Sep 13 03:21:43.460846 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 80/151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:43 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:43.512574 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ad5ebe5c-218b-4640-81f6-f20b4a5854f1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:43.529025 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ad5ebe5c-218b-4640-81f6-f20b4a5854f1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.178764 Sep 13 03:21:43.529879 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 72/152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:43 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:43.861420 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a6543771-ba49-4986-a27d-b73368265c9c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:43.862106 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a6543771-ba49-4986-a27d-b73368265c9c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:43.868039 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6543771-ba49-4986-a27d-b73368265c9c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:43.868687 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6543771-ba49-4986-a27d-b73368265c9c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:43.869160 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6543771-ba49-4986-a27d-b73368265c9c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:43.869826 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6543771-ba49-4986-a27d-b73368265c9c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:43.870277 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6543771-ba49-4986-a27d-b73368265c9c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:43.870717 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6543771-ba49-4986-a27d-b73368265c9c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:44.006496 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a6543771-ba49-4986-a27d-b73368265c9c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:44.014094 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a6543771-ba49-4986-a27d-b73368265c9c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.156694 Sep 13 03:21:44.014759 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 81/153] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:43 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:44.067754 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8a4b2a77-5466-44a2-ad5c-93170c5ec380 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:44.068363 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8a4b2a77-5466-44a2-ad5c-93170c5ec380 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:44.074302 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8a4b2a77-5466-44a2-ad5c-93170c5ec380 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:44.074912 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8a4b2a77-5466-44a2-ad5c-93170c5ec380 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:44.075263 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8a4b2a77-5466-44a2-ad5c-93170c5ec380 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:44.076030 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8a4b2a77-5466-44a2-ad5c-93170c5ec380 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:44.076397 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8a4b2a77-5466-44a2-ad5c-93170c5ec380 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:44.076830 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8a4b2a77-5466-44a2-ad5c-93170c5ec380 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:44.119269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-de37f56a-4516-40d5-9e84-2289ba6bd1ad tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:44.119983 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-de37f56a-4516-40d5-9e84-2289ba6bd1ad tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:44.126384 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de37f56a-4516-40d5-9e84-2289ba6bd1ad tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:44.126905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de37f56a-4516-40d5-9e84-2289ba6bd1ad tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:44.127344 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de37f56a-4516-40d5-9e84-2289ba6bd1ad tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:44.128044 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de37f56a-4516-40d5-9e84-2289ba6bd1ad tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:44.128497 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de37f56a-4516-40d5-9e84-2289ba6bd1ad tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:44.129591 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de37f56a-4516-40d5-9e84-2289ba6bd1ad tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:44.216468 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-8a4b2a77-5466-44a2-ad5c-93170c5ec380 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:44.224701 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8a4b2a77-5466-44a2-ad5c-93170c5ec380 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.161213 Sep 13 03:21:44.225275 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 73/154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:44 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:44.264608 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-375af666-2cf0-40a8-ba04-533c63fb446e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:44.265235 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-375af666-2cf0-40a8-ba04-533c63fb446e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:44.268153 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-de37f56a-4516-40d5-9e84-2289ba6bd1ad tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:44.271359 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-375af666-2cf0-40a8-ba04-533c63fb446e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:44.271755 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:44.271867 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-375af666-2cf0-40a8-ba04-533c63fb446e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:44.272300 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-375af666-2cf0-40a8-ba04-533c63fb446e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:44.272997 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-375af666-2cf0-40a8-ba04-533c63fb446e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:44.273449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-375af666-2cf0-40a8-ba04-533c63fb446e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:44.274043 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-375af666-2cf0-40a8-ba04-533c63fb446e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:44.277674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-de37f56a-4516-40d5-9e84-2289ba6bd1ad tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.162220 Sep 13 03:21:44.278246 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 82/155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:44 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:44.403286 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-375af666-2cf0-40a8-ba04-533c63fb446e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:44.414203 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-375af666-2cf0-40a8-ba04-533c63fb446e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:44.415870 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-375af666-2cf0-40a8-ba04-533c63fb446e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:44.417110 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-375af666-2cf0-40a8-ba04-533c63fb446e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.156416 Sep 13 03:21:44.418344 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 74/156] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:44 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:21:44.484481 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d33e1534-46ec-4ad8-b390-098a0816c698 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:44.485642 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d33e1534-46ec-4ad8-b390-098a0816c698 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:44.493263 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d33e1534-46ec-4ad8-b390-098a0816c698 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:44.494111 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d33e1534-46ec-4ad8-b390-098a0816c698 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:44.495405 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d33e1534-46ec-4ad8-b390-098a0816c698 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:44.496610 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d33e1534-46ec-4ad8-b390-098a0816c698 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:44.501049 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d33e1534-46ec-4ad8-b390-098a0816c698 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:44.502028 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d33e1534-46ec-4ad8-b390-098a0816c698 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:44.553966 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e7022094-b160-458f-921a-6815184ef864 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:44.554987 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e7022094-b160-458f-921a-6815184ef864 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:44.564950 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e7022094-b160-458f-921a-6815184ef864 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:44.565761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e7022094-b160-458f-921a-6815184ef864 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:44.566446 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e7022094-b160-458f-921a-6815184ef864 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:44.567442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e7022094-b160-458f-921a-6815184ef864 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:44.568879 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e7022094-b160-458f-921a-6815184ef864 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:44.571568 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e7022094-b160-458f-921a-6815184ef864 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:44.748295 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d33e1534-46ec-4ad8-b390-098a0816c698 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:44.756590 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d33e1534-46ec-4ad8-b390-098a0816c698 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.276158 Sep 13 03:21:44.757397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 83/157] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:44 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:45.005665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-e7022094-b160-458f-921a-6815184ef864 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:45.017787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e7022094-b160-458f-921a-6815184ef864 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.467502 Sep 13 03:21:45.021468 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 75/158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:44 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:45.046222 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-05c9a388-aaca-4c60-9b16-3385238014f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:45.047337 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-05c9a388-aaca-4c60-9b16-3385238014f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:45.051331 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:45.067508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05c9a388-aaca-4c60-9b16-3385238014f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:45.071211 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05c9a388-aaca-4c60-9b16-3385238014f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:45.073075 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05c9a388-aaca-4c60-9b16-3385238014f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:45.074554 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05c9a388-aaca-4c60-9b16-3385238014f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:45.076177 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05c9a388-aaca-4c60-9b16-3385238014f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:45.077112 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05c9a388-aaca-4c60-9b16-3385238014f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:45.249902 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-aea12806-890b-43bb-bedb-fa9d0f1119c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:45.250519 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-aea12806-890b-43bb-bedb-fa9d0f1119c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:45.264000 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aea12806-890b-43bb-bedb-fa9d0f1119c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:45.265038 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aea12806-890b-43bb-bedb-fa9d0f1119c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:45.265524 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aea12806-890b-43bb-bedb-fa9d0f1119c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:45.266400 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aea12806-890b-43bb-bedb-fa9d0f1119c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:45.270355 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aea12806-890b-43bb-bedb-fa9d0f1119c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:45.270355 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aea12806-890b-43bb-bedb-fa9d0f1119c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:45.385054 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-05c9a388-aaca-4c60-9b16-3385238014f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:45.398517 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-05c9a388-aaca-4c60-9b16-3385238014f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.358202 Sep 13 03:21:45.399317 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 84/159] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:45 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:45.405519 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1dd6043f-5442-48d2-a7e0-c448360a27e0 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:45.406322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1dd6043f-5442-48d2-a7e0-c448360a27e0 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:45.412593 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1dd6043f-5442-48d2-a7e0-c448360a27e0 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:45.413371 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1dd6043f-5442-48d2-a7e0-c448360a27e0 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:45.416161 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1dd6043f-5442-48d2-a7e0-c448360a27e0 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:45.424646 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1dd6043f-5442-48d2-a7e0-c448360a27e0 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:45.425217 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1dd6043f-5442-48d2-a7e0-c448360a27e0 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:45.427233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1dd6043f-5442-48d2-a7e0-c448360a27e0 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:45.645411 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1dd6043f-5442-48d2-a7e0-c448360a27e0 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:45.653755 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1dd6043f-5442-48d2-a7e0-c448360a27e0 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.253061 Sep 13 03:21:45.654268 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 85/160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:45 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:45.666532 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-351d9b7b-5d86-4221-83dd-1a923604bbc0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:45.668199 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-351d9b7b-5d86-4221-83dd-1a923604bbc0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:45.676835 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-351d9b7b-5d86-4221-83dd-1a923604bbc0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:45.677580 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-351d9b7b-5d86-4221-83dd-1a923604bbc0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:45.678228 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-351d9b7b-5d86-4221-83dd-1a923604bbc0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:45.679340 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-351d9b7b-5d86-4221-83dd-1a923604bbc0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:45.679854 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-351d9b7b-5d86-4221-83dd-1a923604bbc0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:45.680466 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-351d9b7b-5d86-4221-83dd-1a923604bbc0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:45.730454 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-aea12806-890b-43bb-bedb-fa9d0f1119c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:45.745799 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-aea12806-890b-43bb-bedb-fa9d0f1119c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.499947 Sep 13 03:21:45.746394 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 76/161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:45 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:45.756739 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-c13aa642-c2da-4d8a-91e3-07ca6bfb2d1c req-e59e2fa5-e1af-4c51-adfb-764a66a23dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0445581f-c40d-4838-864c-bb080dcf594b", "tag": "f18a4265-4277-4b61-a45f-eca4e86395c8"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:45.771815 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-c13aa642-c2da-4d8a-91e3-07ca6bfb2d1c req-e59e2fa5-e1af-4c51-adfb-764a66a23dc2 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:45.772681 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-c13aa642-c2da-4d8a-91e3-07ca6bfb2d1c req-e59e2fa5-e1af-4c51-adfb-764a66a23dc2 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:45.773866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-c13aa642-c2da-4d8a-91e3-07ca6bfb2d1c req-e59e2fa5-e1af-4c51-adfb-764a66a23dc2 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:45.790287 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-c13aa642-c2da-4d8a-91e3-07ca6bfb2d1c req-e59e2fa5-e1af-4c51-adfb-764a66a23dc2 service nova] Creating event network-changed:f18a4265-4277-4b61-a45f-eca4e86395c8 for instance 0445581f-c40d-4838-864c-bb080dcf594b on hv-cinder-85707 Sep 13 03:21:45.798889 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-c13aa642-c2da-4d8a-91e3-07ca6bfb2d1c req-e59e2fa5-e1af-4c51-adfb-764a66a23dc2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046082 Sep 13 03:21:45.799731 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 77/162] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:21:45.815671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3d46c720-f954-47aa-9b3b-36ae5ba47f43 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:45.821526 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3d46c720-f954-47aa-9b3b-36ae5ba47f43 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:45.831707 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d46c720-f954-47aa-9b3b-36ae5ba47f43 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:45.832466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d46c720-f954-47aa-9b3b-36ae5ba47f43 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:45.838817 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d46c720-f954-47aa-9b3b-36ae5ba47f43 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:45.839831 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d46c720-f954-47aa-9b3b-36ae5ba47f43 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:45.839949 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-351d9b7b-5d86-4221-83dd-1a923604bbc0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:45.840785 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d46c720-f954-47aa-9b3b-36ae5ba47f43 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:45.841482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d46c720-f954-47aa-9b3b-36ae5ba47f43 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:45.848942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-351d9b7b-5d86-4221-83dd-1a923604bbc0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:45.851302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-351d9b7b-5d86-4221-83dd-1a923604bbc0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:45.852601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-351d9b7b-5d86-4221-83dd-1a923604bbc0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.197143 Sep 13 03:21:45.853768 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 86/163] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:45 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:45.931066 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=4 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:45.984311 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-853ecdbe-bd6c-4338-8382-bcc8e5c3b2c6 req-d286bd4d-b76f-4729-851f-98587001e8fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c384f0-cb60-4c77-94da-1c9b8055f3fe", "tag": "cd68b0ee-f68a-44d9-87ad-66638f02cae6"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:45.998337 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-853ecdbe-bd6c-4338-8382-bcc8e5c3b2c6 req-d286bd4d-b76f-4729-851f-98587001e8fc service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:46.000201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-853ecdbe-bd6c-4338-8382-bcc8e5c3b2c6 req-d286bd4d-b76f-4729-851f-98587001e8fc service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:46.000631 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-853ecdbe-bd6c-4338-8382-bcc8e5c3b2c6 req-d286bd4d-b76f-4729-851f-98587001e8fc service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:46.023039 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-853ecdbe-bd6c-4338-8382-bcc8e5c3b2c6 req-d286bd4d-b76f-4729-851f-98587001e8fc service nova] Creating event network-changed:cd68b0ee-f68a-44d9-87ad-66638f02cae6 for instance 01c384f0-cb60-4c77-94da-1c9b8055f3fe on hv-cinder-85707 Sep 13 03:21:46.029434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-853ecdbe-bd6c-4338-8382-bcc8e5c3b2c6 req-d286bd4d-b76f-4729-851f-98587001e8fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050310 Sep 13 03:21:46.030834 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 87/164] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:21:46.054498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b6cdfdb4-e7eb-4058-99b4-c9fa1abd18ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:46.055462 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b6cdfdb4-e7eb-4058-99b4-c9fa1abd18ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:46.070862 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b6cdfdb4-e7eb-4058-99b4-c9fa1abd18ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:46.074129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b6cdfdb4-e7eb-4058-99b4-c9fa1abd18ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:46.074720 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b6cdfdb4-e7eb-4058-99b4-c9fa1abd18ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:46.075566 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b6cdfdb4-e7eb-4058-99b4-c9fa1abd18ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:46.076292 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b6cdfdb4-e7eb-4058-99b4-c9fa1abd18ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:46.076985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b6cdfdb4-e7eb-4058-99b4-c9fa1abd18ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:46.155593 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3d46c720-f954-47aa-9b3b-36ae5ba47f43 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:46.164133 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3d46c720-f954-47aa-9b3b-36ae5ba47f43 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.362121 Sep 13 03:21:46.164953 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 78/165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:45 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:46.282329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b6cdfdb4-e7eb-4058-99b4-c9fa1abd18ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:46.291504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b6cdfdb4-e7eb-4058-99b4-c9fa1abd18ef tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.244606 Sep 13 03:21:46.292080 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 88/166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:46 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:46.422998 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ef35b5a4-b712-4c68-a4c1-8406f2260703 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:46.423691 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ef35b5a4-b712-4c68-a4c1-8406f2260703 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:46.432707 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef35b5a4-b712-4c68-a4c1-8406f2260703 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:46.433554 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef35b5a4-b712-4c68-a4c1-8406f2260703 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:46.434056 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef35b5a4-b712-4c68-a4c1-8406f2260703 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:46.434843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef35b5a4-b712-4c68-a4c1-8406f2260703 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:46.435496 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef35b5a4-b712-4c68-a4c1-8406f2260703 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:46.435985 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef35b5a4-b712-4c68-a4c1-8406f2260703 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:46.588899 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ef35b5a4-b712-4c68-a4c1-8406f2260703 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:46.607752 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ef35b5a4-b712-4c68-a4c1-8406f2260703 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.190211 Sep 13 03:21:46.608331 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 79/167] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:46 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:46.677748 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b08585c5-52d9-4858-9bd2-bbd6b10da619 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:46.678573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b08585c5-52d9-4858-9bd2-bbd6b10da619 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:46.686048 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:46.689471 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b08585c5-52d9-4858-9bd2-bbd6b10da619 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:46.691162 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b08585c5-52d9-4858-9bd2-bbd6b10da619 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:46.692510 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b08585c5-52d9-4858-9bd2-bbd6b10da619 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:46.693518 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b08585c5-52d9-4858-9bd2-bbd6b10da619 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:46.694216 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b08585c5-52d9-4858-9bd2-bbd6b10da619 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:46.694762 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b08585c5-52d9-4858-9bd2-bbd6b10da619 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:46.773370 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-37df2e84-1841-4dcb-a6a9-2c45dc8c9a4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:46.774153 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-37df2e84-1841-4dcb-a6a9-2c45dc8c9a4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:46.781694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-37df2e84-1841-4dcb-a6a9-2c45dc8c9a4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:46.782787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-37df2e84-1841-4dcb-a6a9-2c45dc8c9a4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:46.783411 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-37df2e84-1841-4dcb-a6a9-2c45dc8c9a4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:46.784722 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-37df2e84-1841-4dcb-a6a9-2c45dc8c9a4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:46.785587 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-37df2e84-1841-4dcb-a6a9-2c45dc8c9a4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:46.786231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-37df2e84-1841-4dcb-a6a9-2c45dc8c9a4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:46.868502 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b08585c5-52d9-4858-9bd2-bbd6b10da619 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:46.876662 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b08585c5-52d9-4858-9bd2-bbd6b10da619 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.204005 Sep 13 03:21:46.877314 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 89/168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:46 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:46.883869 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7742a15c-5b91-4985-84c2-640955f4d498 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:46.884716 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7742a15c-5b91-4985-84c2-640955f4d498 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:46.891824 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7742a15c-5b91-4985-84c2-640955f4d498 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:46.892646 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7742a15c-5b91-4985-84c2-640955f4d498 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:46.893274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7742a15c-5b91-4985-84c2-640955f4d498 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:46.894195 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7742a15c-5b91-4985-84c2-640955f4d498 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:46.895412 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7742a15c-5b91-4985-84c2-640955f4d498 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:46.895958 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7742a15c-5b91-4985-84c2-640955f4d498 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:46.989149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-37df2e84-1841-4dcb-a6a9-2c45dc8c9a4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:46.997176 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-37df2e84-1841-4dcb-a6a9-2c45dc8c9a4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.228750 Sep 13 03:21:46.997862 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 80/169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:46 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:47.043467 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7742a15c-5b91-4985-84c2-640955f4d498 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:47.051731 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7742a15c-5b91-4985-84c2-640955f4d498 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:47.053155 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7742a15c-5b91-4985-84c2-640955f4d498 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:47.054261 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7742a15c-5b91-4985-84c2-640955f4d498 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.175636 Sep 13 03:21:47.054839 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 90/170] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:46 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:47.186893 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-590f8bce-004a-4045-a962-8cc1818b5085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:47.187504 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-590f8bce-004a-4045-a962-8cc1818b5085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:47.194237 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-590f8bce-004a-4045-a962-8cc1818b5085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:47.194885 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-590f8bce-004a-4045-a962-8cc1818b5085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:47.195359 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-590f8bce-004a-4045-a962-8cc1818b5085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:47.196074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-590f8bce-004a-4045-a962-8cc1818b5085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:47.196524 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-590f8bce-004a-4045-a962-8cc1818b5085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:47.196950 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-590f8bce-004a-4045-a962-8cc1818b5085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:47.315985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ab88580d-e889-41b8-837c-e31536e6528e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:47.317360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ab88580d-e889-41b8-837c-e31536e6528e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:47.326144 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ab88580d-e889-41b8-837c-e31536e6528e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:47.326814 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ab88580d-e889-41b8-837c-e31536e6528e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:47.327263 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ab88580d-e889-41b8-837c-e31536e6528e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:47.328146 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ab88580d-e889-41b8-837c-e31536e6528e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:47.328649 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ab88580d-e889-41b8-837c-e31536e6528e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:47.329233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ab88580d-e889-41b8-837c-e31536e6528e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:47.336451 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-590f8bce-004a-4045-a962-8cc1818b5085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:47.344333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-590f8bce-004a-4045-a962-8cc1818b5085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.161370 Sep 13 03:21:47.345322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 81/171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:47 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:47.474896 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ab88580d-e889-41b8-837c-e31536e6528e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:47.482562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ab88580d-e889-41b8-837c-e31536e6528e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.171191 Sep 13 03:21:47.483153 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 91/172] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:47 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:47.629357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7bc6e120-3e2c-4dc1-b259-15070248a334 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:47.629970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7bc6e120-3e2c-4dc1-b259-15070248a334 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:47.635786 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7bc6e120-3e2c-4dc1-b259-15070248a334 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:47.636273 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7bc6e120-3e2c-4dc1-b259-15070248a334 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:47.636708 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7bc6e120-3e2c-4dc1-b259-15070248a334 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:47.637401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7bc6e120-3e2c-4dc1-b259-15070248a334 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:47.637853 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7bc6e120-3e2c-4dc1-b259-15070248a334 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:47.638274 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7bc6e120-3e2c-4dc1-b259-15070248a334 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:47.778230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7bc6e120-3e2c-4dc1-b259-15070248a334 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:47.787524 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7bc6e120-3e2c-4dc1-b259-15070248a334 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.161844 Sep 13 03:21:47.788027 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 82/173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:47 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:47.902908 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-247a1bc8-6c7f-454a-bcc2-bd228955830a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:47.903524 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-247a1bc8-6c7f-454a-bcc2-bd228955830a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:47.911166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-247a1bc8-6c7f-454a-bcc2-bd228955830a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:47.911793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-247a1bc8-6c7f-454a-bcc2-bd228955830a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:47.912336 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-247a1bc8-6c7f-454a-bcc2-bd228955830a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:47.913143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-247a1bc8-6c7f-454a-bcc2-bd228955830a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:47.913748 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-247a1bc8-6c7f-454a-bcc2-bd228955830a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:47.914324 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-247a1bc8-6c7f-454a-bcc2-bd228955830a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:48.021304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8830cf6b-3b96-4a90-82b9-1103c5d30b90 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:48.021925 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8830cf6b-3b96-4a90-82b9-1103c5d30b90 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:48.037297 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8830cf6b-3b96-4a90-82b9-1103c5d30b90 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:48.040618 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8830cf6b-3b96-4a90-82b9-1103c5d30b90 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:48.046315 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8830cf6b-3b96-4a90-82b9-1103c5d30b90 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:48.047217 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8830cf6b-3b96-4a90-82b9-1103c5d30b90 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:48.048108 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8830cf6b-3b96-4a90-82b9-1103c5d30b90 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:48.049891 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8830cf6b-3b96-4a90-82b9-1103c5d30b90 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:48.086478 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-247a1bc8-6c7f-454a-bcc2-bd228955830a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:48.097179 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-247a1bc8-6c7f-454a-bcc2-bd228955830a tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.198185 Sep 13 03:21:48.110301 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 92/174] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:47 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:48.120429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-bb45b72e-d4b3-4847-a182-701b390aadac req-45274dd1-34b1-4033-9845-76b574e60652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab865ad-8ee0-4def-a996-caa5e4e30f30", "tag": "99e3ee84-e44d-466c-bb25-da0a34a04a5e"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:48.132093 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-bb45b72e-d4b3-4847-a182-701b390aadac req-45274dd1-34b1-4033-9845-76b574e60652 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:48.132918 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-bb45b72e-d4b3-4847-a182-701b390aadac req-45274dd1-34b1-4033-9845-76b574e60652 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:48.133501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-bb45b72e-d4b3-4847-a182-701b390aadac req-45274dd1-34b1-4033-9845-76b574e60652 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:48.149598 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-bb45b72e-d4b3-4847-a182-701b390aadac req-45274dd1-34b1-4033-9845-76b574e60652 service nova] Creating event network-changed:99e3ee84-e44d-466c-bb25-da0a34a04a5e for instance dab865ad-8ee0-4def-a996-caa5e4e30f30 on hv-cinder-85707 Sep 13 03:21:48.158027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-bb45b72e-d4b3-4847-a182-701b390aadac req-45274dd1-34b1-4033-9845-76b574e60652 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045690 Sep 13 03:21:48.161513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 93/175] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:21:48.172693 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-303fcaa7-1982-4278-ae11-dc1037c366f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:48.173900 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-303fcaa7-1982-4278-ae11-dc1037c366f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:48.183421 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-303fcaa7-1982-4278-ae11-dc1037c366f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:48.184223 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-303fcaa7-1982-4278-ae11-dc1037c366f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:48.184816 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-303fcaa7-1982-4278-ae11-dc1037c366f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:48.185942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-303fcaa7-1982-4278-ae11-dc1037c366f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:48.187322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-303fcaa7-1982-4278-ae11-dc1037c366f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:48.188125 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-303fcaa7-1982-4278-ae11-dc1037c366f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:48.236691 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-8830cf6b-3b96-4a90-82b9-1103c5d30b90 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:48.244555 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8830cf6b-3b96-4a90-82b9-1103c5d30b90 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.227951 Sep 13 03:21:48.247415 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 83/176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:48 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:48.362796 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-303fcaa7-1982-4278-ae11-dc1037c366f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:48.376218 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a4300ba5-d7c3-4301-a59f-b2c49dbea3c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:48.376840 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a4300ba5-d7c3-4301-a59f-b2c49dbea3c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:48.384284 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-303fcaa7-1982-4278-ae11-dc1037c366f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:48.386146 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-303fcaa7-1982-4278-ae11-dc1037c366f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:48.387200 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a4300ba5-d7c3-4301-a59f-b2c49dbea3c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:48.387781 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-303fcaa7-1982-4278-ae11-dc1037c366f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.223944 Sep 13 03:21:48.387995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a4300ba5-d7c3-4301-a59f-b2c49dbea3c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:48.388434 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a4300ba5-d7c3-4301-a59f-b2c49dbea3c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:48.389133 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a4300ba5-d7c3-4301-a59f-b2c49dbea3c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:48.389675 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 94/177] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:48 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:48.391434 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a4300ba5-d7c3-4301-a59f-b2c49dbea3c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:48.391892 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a4300ba5-d7c3-4301-a59f-b2c49dbea3c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:48.506187 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0b043cd0-9bb8-4bee-be32-9d2c99fb7e1e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:48.507169 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0b043cd0-9bb8-4bee-be32-9d2c99fb7e1e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:48.513130 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0b043cd0-9bb8-4bee-be32-9d2c99fb7e1e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:48.513864 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0b043cd0-9bb8-4bee-be32-9d2c99fb7e1e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:48.514489 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0b043cd0-9bb8-4bee-be32-9d2c99fb7e1e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:48.515598 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0b043cd0-9bb8-4bee-be32-9d2c99fb7e1e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:48.516703 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0b043cd0-9bb8-4bee-be32-9d2c99fb7e1e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:48.517352 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0b043cd0-9bb8-4bee-be32-9d2c99fb7e1e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:48.549144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a4300ba5-d7c3-4301-a59f-b2c49dbea3c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:48.560097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a4300ba5-d7c3-4301-a59f-b2c49dbea3c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.190853 Sep 13 03:21:48.569762 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 84/178] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:48 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:48.642782 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-dbf50db7-35a2-4b8e-be9d-17e28af9fd33 req-6ca490f5-8735-4e0e-bfd3-0a2ddc5e89af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81", "name": "network-vif-plugged", "status": "completed", "tag": "5e1eb65a-db49-4f23-a402-182f179922bc"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:48.653236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-dbf50db7-35a2-4b8e-be9d-17e28af9fd33 req-6ca490f5-8735-4e0e-bfd3-0a2ddc5e89af service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:48.653729 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-dbf50db7-35a2-4b8e-be9d-17e28af9fd33 req-6ca490f5-8735-4e0e-bfd3-0a2ddc5e89af service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:48.654166 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-dbf50db7-35a2-4b8e-be9d-17e28af9fd33 req-6ca490f5-8735-4e0e-bfd3-0a2ddc5e89af service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:48.668243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-dbf50db7-35a2-4b8e-be9d-17e28af9fd33 req-6ca490f5-8735-4e0e-bfd3-0a2ddc5e89af service nova] Creating event network-vif-plugged:5e1eb65a-db49-4f23-a402-182f179922bc for instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 on hv-cinder-85707 Sep 13 03:21:48.673774 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-dbf50db7-35a2-4b8e-be9d-17e28af9fd33 req-6ca490f5-8735-4e0e-bfd3-0a2ddc5e89af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102576 Sep 13 03:21:48.674373 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 85/179] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:21:48.714949 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0b043cd0-9bb8-4bee-be32-9d2c99fb7e1e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:48.728290 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0b043cd0-9bb8-4bee-be32-9d2c99fb7e1e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.226180 Sep 13 03:21:48.729086 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 95/180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:48 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:48.822763 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-42dfb5aa-d697-4002-a534-375e1d208276 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:48.824719 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-42dfb5aa-d697-4002-a534-375e1d208276 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:48.836401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-42dfb5aa-d697-4002-a534-375e1d208276 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:48.837116 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-42dfb5aa-d697-4002-a534-375e1d208276 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:48.838996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-42dfb5aa-d697-4002-a534-375e1d208276 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:48.839879 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-42dfb5aa-d697-4002-a534-375e1d208276 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:48.840657 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-42dfb5aa-d697-4002-a534-375e1d208276 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:48.841575 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-42dfb5aa-d697-4002-a534-375e1d208276 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:48.848874 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=100 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:49.013945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-42dfb5aa-d697-4002-a534-375e1d208276 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:49.024067 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-42dfb5aa-d697-4002-a534-375e1d208276 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.214572 Sep 13 03:21:49.036391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 86/181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:48 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:49.125003 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d31e63c9-66f1-482a-989e-006963c09b8d tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:49.127303 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d31e63c9-66f1-482a-989e-006963c09b8d tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:49.144567 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d31e63c9-66f1-482a-989e-006963c09b8d tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:49.150064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d31e63c9-66f1-482a-989e-006963c09b8d tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:49.150624 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d31e63c9-66f1-482a-989e-006963c09b8d tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:49.151712 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d31e63c9-66f1-482a-989e-006963c09b8d tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:49.153192 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d31e63c9-66f1-482a-989e-006963c09b8d tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:49.154576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d31e63c9-66f1-482a-989e-006963c09b8d tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:49.270341 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4379f0f4-dcb4-44d7-918b-133951dceecc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:49.270934 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-4379f0f4-dcb4-44d7-918b-133951dceecc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:49.288127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4379f0f4-dcb4-44d7-918b-133951dceecc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:49.288917 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4379f0f4-dcb4-44d7-918b-133951dceecc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:49.289359 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4379f0f4-dcb4-44d7-918b-133951dceecc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:49.290074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4379f0f4-dcb4-44d7-918b-133951dceecc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:49.290530 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4379f0f4-dcb4-44d7-918b-133951dceecc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:49.290973 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4379f0f4-dcb4-44d7-918b-133951dceecc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:49.963037 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d31e63c9-66f1-482a-989e-006963c09b8d tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:49.970758 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d31e63c9-66f1-482a-989e-006963c09b8d tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.852204 Sep 13 03:21:49.983719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 96/182] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:49 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:50.001275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5c57f7ab-d5c1-4710-8bee-6ea5acce14de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:50.001883 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5c57f7ab-d5c1-4710-8bee-6ea5acce14de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:50.018124 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5c57f7ab-d5c1-4710-8bee-6ea5acce14de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:50.018599 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5c57f7ab-d5c1-4710-8bee-6ea5acce14de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:50.019061 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5c57f7ab-d5c1-4710-8bee-6ea5acce14de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:50.020373 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5c57f7ab-d5c1-4710-8bee-6ea5acce14de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:50.021013 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5c57f7ab-d5c1-4710-8bee-6ea5acce14de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:50.021586 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5c57f7ab-d5c1-4710-8bee-6ea5acce14de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:50.040239 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4379f0f4-dcb4-44d7-918b-133951dceecc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:50.054391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4379f0f4-dcb4-44d7-918b-133951dceecc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.787942 Sep 13 03:21:50.056532 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 87/183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:49 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:50.062521 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8e61e2ce-7465-47c1-862d-c9b325ee73fa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:50.065957 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8e61e2ce-7465-47c1-862d-c9b325ee73fa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:50.073663 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8e61e2ce-7465-47c1-862d-c9b325ee73fa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:50.074900 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8e61e2ce-7465-47c1-862d-c9b325ee73fa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:50.076309 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8e61e2ce-7465-47c1-862d-c9b325ee73fa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:50.077857 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8e61e2ce-7465-47c1-862d-c9b325ee73fa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:50.078587 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8e61e2ce-7465-47c1-862d-c9b325ee73fa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:50.079257 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8e61e2ce-7465-47c1-862d-c9b325ee73fa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:50.237948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5c57f7ab-d5c1-4710-8bee-6ea5acce14de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:50.251231 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5c57f7ab-d5c1-4710-8bee-6ea5acce14de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:50.253476 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5c57f7ab-d5c1-4710-8bee-6ea5acce14de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:50.255041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5c57f7ab-d5c1-4710-8bee-6ea5acce14de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.269893 Sep 13 03:21:50.256269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 97/184] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:49 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:50.263942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a02d82ee-6348-40f8-bfdb-98f27a7034a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:50.264954 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a02d82ee-6348-40f8-bfdb-98f27a7034a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:50.277154 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a02d82ee-6348-40f8-bfdb-98f27a7034a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:50.285923 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a02d82ee-6348-40f8-bfdb-98f27a7034a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:50.286650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a02d82ee-6348-40f8-bfdb-98f27a7034a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:50.287430 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a02d82ee-6348-40f8-bfdb-98f27a7034a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:50.287959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a02d82ee-6348-40f8-bfdb-98f27a7034a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:50.288373 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a02d82ee-6348-40f8-bfdb-98f27a7034a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:50.312670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-8e61e2ce-7465-47c1-862d-c9b325ee73fa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:50.323836 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8e61e2ce-7465-47c1-862d-c9b325ee73fa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.265573 Sep 13 03:21:50.324422 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 88/185] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:50 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:50.329997 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-87245454-d788-42b2-bdab-c0a2b70595d0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:50.330835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-87245454-d788-42b2-bdab-c0a2b70595d0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:50.338834 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87245454-d788-42b2-bdab-c0a2b70595d0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:50.339575 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87245454-d788-42b2-bdab-c0a2b70595d0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:50.340006 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87245454-d788-42b2-bdab-c0a2b70595d0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:50.340703 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87245454-d788-42b2-bdab-c0a2b70595d0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:50.341153 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87245454-d788-42b2-bdab-c0a2b70595d0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:50.341742 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87245454-d788-42b2-bdab-c0a2b70595d0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:50.456673 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a02d82ee-6348-40f8-bfdb-98f27a7034a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:50.465546 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a02d82ee-6348-40f8-bfdb-98f27a7034a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.207434 Sep 13 03:21:50.466353 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 98/186] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:50 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:50.536878 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-87245454-d788-42b2-bdab-c0a2b70595d0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:50.547009 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-87245454-d788-42b2-bdab-c0a2b70595d0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.221366 Sep 13 03:21:50.547584 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 89/187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:50 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:50.696130 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-4c54457f-3e20-47f6-af63-074585b0329b req-eceadc99-9f63-4ee2-8c86-75ea2c60b613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92a5fc3-da4f-47bf-ab5e-c9c275f38332", "name": "network-vif-plugged", "status": "completed", "tag": "c44d8cab-cafe-42d0-9df1-25b1e426b401"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:50.707978 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-4c54457f-3e20-47f6-af63-074585b0329b req-eceadc99-9f63-4ee2-8c86-75ea2c60b613 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:50.708626 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-4c54457f-3e20-47f6-af63-074585b0329b req-eceadc99-9f63-4ee2-8c86-75ea2c60b613 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:50.709218 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-4c54457f-3e20-47f6-af63-074585b0329b req-eceadc99-9f63-4ee2-8c86-75ea2c60b613 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:50.723206 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-4c54457f-3e20-47f6-af63-074585b0329b req-eceadc99-9f63-4ee2-8c86-75ea2c60b613 service nova] Creating event network-vif-plugged:c44d8cab-cafe-42d0-9df1-25b1e426b401 for instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 on hv-cinder-85707 Sep 13 03:21:50.729850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-4c54457f-3e20-47f6-af63-074585b0329b req-eceadc99-9f63-4ee2-8c86-75ea2c60b613 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039816 Sep 13 03:21:50.730862 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 99/188] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:21:51.008216 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a08ca064-1d41-4440-b9ed-961a5a1564b5 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:51.008832 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a08ca064-1d41-4440-b9ed-961a5a1564b5 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:51.016115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a08ca064-1d41-4440-b9ed-961a5a1564b5 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:51.016744 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a08ca064-1d41-4440-b9ed-961a5a1564b5 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:51.017371 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a08ca064-1d41-4440-b9ed-961a5a1564b5 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:51.018263 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a08ca064-1d41-4440-b9ed-961a5a1564b5 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:51.018811 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a08ca064-1d41-4440-b9ed-961a5a1564b5 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:51.019286 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a08ca064-1d41-4440-b9ed-961a5a1564b5 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:51.088157 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-530c8087-26bd-4b8e-bb48-5c6743b4e0be tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:51.088775 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-530c8087-26bd-4b8e-bb48-5c6743b4e0be tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:51.095201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-530c8087-26bd-4b8e-bb48-5c6743b4e0be tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:51.095936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-530c8087-26bd-4b8e-bb48-5c6743b4e0be tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:51.096518 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-530c8087-26bd-4b8e-bb48-5c6743b4e0be tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:51.097449 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-530c8087-26bd-4b8e-bb48-5c6743b4e0be tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:51.098111 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-530c8087-26bd-4b8e-bb48-5c6743b4e0be tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:51.098700 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-530c8087-26bd-4b8e-bb48-5c6743b4e0be tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:51.165178 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a08ca064-1d41-4440-b9ed-961a5a1564b5 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:51.173401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a08ca064-1d41-4440-b9ed-961a5a1564b5 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.169470 Sep 13 03:21:51.174054 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 90/189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:51 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:51.277064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-530c8087-26bd-4b8e-bb48-5c6743b4e0be tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:51.284395 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-47d23409-46b8-4b1f-9922-6e969aa9696e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:51.285543 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-47d23409-46b8-4b1f-9922-6e969aa9696e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:51.286626 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-530c8087-26bd-4b8e-bb48-5c6743b4e0be tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.203013 Sep 13 03:21:51.287389 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 100/190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:51 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:51.292025 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47d23409-46b8-4b1f-9922-6e969aa9696e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:51.292513 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47d23409-46b8-4b1f-9922-6e969aa9696e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:51.292944 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47d23409-46b8-4b1f-9922-6e969aa9696e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:51.293636 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47d23409-46b8-4b1f-9922-6e969aa9696e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:51.294089 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47d23409-46b8-4b1f-9922-6e969aa9696e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:51.294804 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47d23409-46b8-4b1f-9922-6e969aa9696e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:51.346815 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-deecc86a-044a-49f6-981b-3d53bd8cf059 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:51.347937 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-deecc86a-044a-49f6-981b-3d53bd8cf059 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:51.357998 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-deecc86a-044a-49f6-981b-3d53bd8cf059 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:51.358825 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-deecc86a-044a-49f6-981b-3d53bd8cf059 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:51.359527 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-deecc86a-044a-49f6-981b-3d53bd8cf059 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:51.360464 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-deecc86a-044a-49f6-981b-3d53bd8cf059 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:51.361080 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-deecc86a-044a-49f6-981b-3d53bd8cf059 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:51.361602 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-deecc86a-044a-49f6-981b-3d53bd8cf059 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:51.381187 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:51.444122 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-47d23409-46b8-4b1f-9922-6e969aa9696e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:51.452743 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-47d23409-46b8-4b1f-9922-6e969aa9696e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:51.454318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-47d23409-46b8-4b1f-9922-6e969aa9696e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:51.455555 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-47d23409-46b8-4b1f-9922-6e969aa9696e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.175038 Sep 13 03:21:51.456358 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 91/191] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:51 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:21:51.490419 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9384d71c-e555-4fcb-8934-03311fdff640 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:51.491078 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9384d71c-e555-4fcb-8934-03311fdff640 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:51.497964 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9384d71c-e555-4fcb-8934-03311fdff640 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:51.498988 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9384d71c-e555-4fcb-8934-03311fdff640 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:51.499583 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9384d71c-e555-4fcb-8934-03311fdff640 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:51.500450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9384d71c-e555-4fcb-8934-03311fdff640 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:51.500944 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9384d71c-e555-4fcb-8934-03311fdff640 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:51.501412 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9384d71c-e555-4fcb-8934-03311fdff640 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:51.508187 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-deecc86a-044a-49f6-981b-3d53bd8cf059 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:51.516905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-deecc86a-044a-49f6-981b-3d53bd8cf059 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.174454 Sep 13 03:21:51.517496 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 101/192] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:51 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:51.569755 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-490e951c-5122-40b6-8e4b-18ed3597c002 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:51.570440 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-490e951c-5122-40b6-8e4b-18ed3597c002 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:51.578322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-490e951c-5122-40b6-8e4b-18ed3597c002 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:51.578921 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-490e951c-5122-40b6-8e4b-18ed3597c002 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:51.579358 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-490e951c-5122-40b6-8e4b-18ed3597c002 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:51.580087 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-490e951c-5122-40b6-8e4b-18ed3597c002 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:51.580839 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-490e951c-5122-40b6-8e4b-18ed3597c002 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:51.581020 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-490e951c-5122-40b6-8e4b-18ed3597c002 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:51.645941 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9384d71c-e555-4fcb-8934-03311fdff640 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:51.653489 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9384d71c-e555-4fcb-8934-03311fdff640 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.167946 Sep 13 03:21:51.654056 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 92/193] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:51 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:51.716800 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-490e951c-5122-40b6-8e4b-18ed3597c002 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:51.725228 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-490e951c-5122-40b6-8e4b-18ed3597c002 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.159649 Sep 13 03:21:51.725802 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 102/194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:51 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:52.197124 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-74223420-0502-437d-9f43-5f5bebb86b0f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:52.197739 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-74223420-0502-437d-9f43-5f5bebb86b0f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:52.203626 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-74223420-0502-437d-9f43-5f5bebb86b0f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:52.204120 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-74223420-0502-437d-9f43-5f5bebb86b0f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:52.204553 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-74223420-0502-437d-9f43-5f5bebb86b0f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:52.205247 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-74223420-0502-437d-9f43-5f5bebb86b0f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:52.205842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-74223420-0502-437d-9f43-5f5bebb86b0f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:52.206272 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-74223420-0502-437d-9f43-5f5bebb86b0f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:52.311116 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e252c3c9-d123-4f43-8170-64f912eca593 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:52.313168 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e252c3c9-d123-4f43-8170-64f912eca593 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:52.320537 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e252c3c9-d123-4f43-8170-64f912eca593 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:52.321509 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e252c3c9-d123-4f43-8170-64f912eca593 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:52.322372 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e252c3c9-d123-4f43-8170-64f912eca593 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:52.323592 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e252c3c9-d123-4f43-8170-64f912eca593 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:52.324190 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e252c3c9-d123-4f43-8170-64f912eca593 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:52.324757 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e252c3c9-d123-4f43-8170-64f912eca593 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:52.361782 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-74223420-0502-437d-9f43-5f5bebb86b0f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:52.371697 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-74223420-0502-437d-9f43-5f5bebb86b0f tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.178183 Sep 13 03:21:52.372608 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 93/195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:52 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:52.481640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-aaf237c6-298b-4125-bcee-ecc069abdaad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:52.482257 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-aaf237c6-298b-4125-bcee-ecc069abdaad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:52.483331 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e252c3c9-d123-4f43-8170-64f912eca593 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:52.489273 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aaf237c6-298b-4125-bcee-ecc069abdaad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:52.489779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aaf237c6-298b-4125-bcee-ecc069abdaad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:52.490216 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aaf237c6-298b-4125-bcee-ecc069abdaad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:52.491112 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aaf237c6-298b-4125-bcee-ecc069abdaad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:52.491751 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aaf237c6-298b-4125-bcee-ecc069abdaad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:52.492333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aaf237c6-298b-4125-bcee-ecc069abdaad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:52.493986 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e252c3c9-d123-4f43-8170-64f912eca593 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.187397 Sep 13 03:21:52.494565 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 103/196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:52 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:52.540514 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-14cc89e3-b50a-4d03-9159-36f1ee6c0251 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:52.541458 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-14cc89e3-b50a-4d03-9159-36f1ee6c0251 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:52.552098 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-14cc89e3-b50a-4d03-9159-36f1ee6c0251 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:52.552775 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-14cc89e3-b50a-4d03-9159-36f1ee6c0251 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:52.553370 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-14cc89e3-b50a-4d03-9159-36f1ee6c0251 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:52.554231 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-14cc89e3-b50a-4d03-9159-36f1ee6c0251 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:52.555087 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-14cc89e3-b50a-4d03-9159-36f1ee6c0251 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:52.555676 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-14cc89e3-b50a-4d03-9159-36f1ee6c0251 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:52.685509 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-aaf237c6-298b-4125-bcee-ecc069abdaad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:52.696651 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-aaf237c6-298b-4125-bcee-ecc069abdaad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:52.698535 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-aaf237c6-298b-4125-bcee-ecc069abdaad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:52.700240 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-aaf237c6-298b-4125-bcee-ecc069abdaad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.222408 Sep 13 03:21:52.704746 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 94/197] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:52 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:21:52.709675 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1e1934d1-2425-4e48-9e11-5b30fd95471d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:52.710297 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-1e1934d1-2425-4e48-9e11-5b30fd95471d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:52.721868 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1e1934d1-2425-4e48-9e11-5b30fd95471d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:52.723300 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1e1934d1-2425-4e48-9e11-5b30fd95471d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:52.724002 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1e1934d1-2425-4e48-9e11-5b30fd95471d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:52.725197 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1e1934d1-2425-4e48-9e11-5b30fd95471d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:52.725941 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1e1934d1-2425-4e48-9e11-5b30fd95471d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:52.726563 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1e1934d1-2425-4e48-9e11-5b30fd95471d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:53.165149 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-14cc89e3-b50a-4d03-9159-36f1ee6c0251 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:53.174207 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-14cc89e3-b50a-4d03-9159-36f1ee6c0251 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.638841 Sep 13 03:21:53.175174 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 104/198] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:52 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:53.181154 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c261ca1d-d2cf-422e-9822-88c29558070d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:53.182036 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c261ca1d-d2cf-422e-9822-88c29558070d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:53.189200 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c261ca1d-d2cf-422e-9822-88c29558070d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:53.189914 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c261ca1d-d2cf-422e-9822-88c29558070d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:53.190559 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c261ca1d-d2cf-422e-9822-88c29558070d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:53.191641 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c261ca1d-d2cf-422e-9822-88c29558070d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:53.192293 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c261ca1d-d2cf-422e-9822-88c29558070d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:53.193027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c261ca1d-d2cf-422e-9822-88c29558070d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:53.247871 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-1e1934d1-2425-4e48-9e11-5b30fd95471d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:53.256621 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1e1934d1-2425-4e48-9e11-5b30fd95471d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.550832 Sep 13 03:21:53.257577 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 95/199] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:52 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:53.266386 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-8a30ee8b-27a0-4cca-9ef2-b2ae33c5a52b req-4cf57b64-1328-4abe-965f-a0d5f91f499f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722dd938-0b13-46d0-9fa1-ff945702438c", "name": "network-vif-plugged", "status": "completed", "tag": "3183447b-b590-4633-92e3-7d4198ae1660"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:53.276426 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-8a30ee8b-27a0-4cca-9ef2-b2ae33c5a52b req-4cf57b64-1328-4abe-965f-a0d5f91f499f service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:53.285871 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-8a30ee8b-27a0-4cca-9ef2-b2ae33c5a52b req-4cf57b64-1328-4abe-965f-a0d5f91f499f service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:53.286729 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-8a30ee8b-27a0-4cca-9ef2-b2ae33c5a52b req-4cf57b64-1328-4abe-965f-a0d5f91f499f service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:53.319755 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-8a30ee8b-27a0-4cca-9ef2-b2ae33c5a52b req-4cf57b64-1328-4abe-965f-a0d5f91f499f service nova] Creating event network-vif-plugged:3183447b-b590-4633-92e3-7d4198ae1660 for instance 722dd938-0b13-46d0-9fa1-ff945702438c on hv-cinder-85707 Sep 13 03:21:53.326516 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-8a30ee8b-27a0-4cca-9ef2-b2ae33c5a52b req-4cf57b64-1328-4abe-965f-a0d5f91f499f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067546 Sep 13 03:21:53.327431 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 96/200] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:21:53.417343 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-594db698-c5c9-4d75-a5a6-1a3a58deb68b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:53.420236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-594db698-c5c9-4d75-a5a6-1a3a58deb68b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:53.434870 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-594db698-c5c9-4d75-a5a6-1a3a58deb68b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:53.439189 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-594db698-c5c9-4d75-a5a6-1a3a58deb68b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:53.439792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-594db698-c5c9-4d75-a5a6-1a3a58deb68b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:53.441920 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-594db698-c5c9-4d75-a5a6-1a3a58deb68b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:53.442501 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-594db698-c5c9-4d75-a5a6-1a3a58deb68b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:53.443231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-594db698-c5c9-4d75-a5a6-1a3a58deb68b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:53.536266 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c261ca1d-d2cf-422e-9822-88c29558070d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:53.545096 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c261ca1d-d2cf-422e-9822-88c29558070d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.368584 Sep 13 03:21:53.545663 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 105/201] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:53 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:53.552401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f7161636-78a3-494d-bf01-4464836e51dd tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:53.553214 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f7161636-78a3-494d-bf01-4464836e51dd tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:53.559721 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f7161636-78a3-494d-bf01-4464836e51dd tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:53.560434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f7161636-78a3-494d-bf01-4464836e51dd tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:53.561064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f7161636-78a3-494d-bf01-4464836e51dd tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:53.561757 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f7161636-78a3-494d-bf01-4464836e51dd tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:53.562212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f7161636-78a3-494d-bf01-4464836e51dd tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:53.562665 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f7161636-78a3-494d-bf01-4464836e51dd tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:53.851486 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-594db698-c5c9-4d75-a5a6-1a3a58deb68b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:53.859693 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-594db698-c5c9-4d75-a5a6-1a3a58deb68b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.468651 Sep 13 03:21:53.872985 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 97/202] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:53 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:53.877806 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5c55e537-7f12-45b9-adb2-eb8daab709ec tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:53.878420 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5c55e537-7f12-45b9-adb2-eb8daab709ec tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:53.888666 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c55e537-7f12-45b9-adb2-eb8daab709ec tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:53.889386 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c55e537-7f12-45b9-adb2-eb8daab709ec tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:53.889987 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c55e537-7f12-45b9-adb2-eb8daab709ec tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:53.890896 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c55e537-7f12-45b9-adb2-eb8daab709ec tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:53.891506 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c55e537-7f12-45b9-adb2-eb8daab709ec tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:53.892111 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c55e537-7f12-45b9-adb2-eb8daab709ec tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:54.372458 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f7161636-78a3-494d-bf01-4464836e51dd tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:54.382737 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f7161636-78a3-494d-bf01-4464836e51dd tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.835850 Sep 13 03:21:54.398785 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 106/203] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:53 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:54.404835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5c55e537-7f12-45b9-adb2-eb8daab709ec tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:54.405360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-de1edc11-6517-4c83-963d-c46a3f0e10e3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:54.405645 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-de1edc11-6517-4c83-963d-c46a3f0e10e3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:54.413861 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de1edc11-6517-4c83-963d-c46a3f0e10e3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:54.414132 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5c55e537-7f12-45b9-adb2-eb8daab709ec tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:54.414746 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de1edc11-6517-4c83-963d-c46a3f0e10e3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:54.415395 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de1edc11-6517-4c83-963d-c46a3f0e10e3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:54.416263 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de1edc11-6517-4c83-963d-c46a3f0e10e3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:54.416720 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de1edc11-6517-4c83-963d-c46a3f0e10e3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:54.417143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de1edc11-6517-4c83-963d-c46a3f0e10e3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:54.417429 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5c55e537-7f12-45b9-adb2-eb8daab709ec tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:54.418790 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5c55e537-7f12-45b9-adb2-eb8daab709ec tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.544748 Sep 13 03:21:54.419591 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 98/204] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:53 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:54.424161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-346bea4e-58dd-46c7-bcf9-8a21f3b846be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:54.424943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-346bea4e-58dd-46c7-bcf9-8a21f3b846be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:54.433161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-346bea4e-58dd-46c7-bcf9-8a21f3b846be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:54.433830 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-346bea4e-58dd-46c7-bcf9-8a21f3b846be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:54.434416 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-346bea4e-58dd-46c7-bcf9-8a21f3b846be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:54.435291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-346bea4e-58dd-46c7-bcf9-8a21f3b846be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:54.435901 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-346bea4e-58dd-46c7-bcf9-8a21f3b846be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:54.436481 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-346bea4e-58dd-46c7-bcf9-8a21f3b846be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:54.561362 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-de1edc11-6517-4c83-963d-c46a3f0e10e3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:54.570221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-de1edc11-6517-4c83-963d-c46a3f0e10e3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.170015 Sep 13 03:21:54.571175 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 107/205] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:54 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:54.575859 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-243d8f57-b7b3-4d8e-baad-e57c4fcbba03 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:54.576474 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-243d8f57-b7b3-4d8e-baad-e57c4fcbba03 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:54.583087 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-243d8f57-b7b3-4d8e-baad-e57c4fcbba03 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:54.583590 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-243d8f57-b7b3-4d8e-baad-e57c4fcbba03 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:54.584026 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-243d8f57-b7b3-4d8e-baad-e57c4fcbba03 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:54.584724 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-243d8f57-b7b3-4d8e-baad-e57c4fcbba03 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:54.585179 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-243d8f57-b7b3-4d8e-baad-e57c4fcbba03 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:54.585659 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-243d8f57-b7b3-4d8e-baad-e57c4fcbba03 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:54.609260 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-346bea4e-58dd-46c7-bcf9-8a21f3b846be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:54.617458 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-346bea4e-58dd-46c7-bcf9-8a21f3b846be tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.196709 Sep 13 03:21:54.618973 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 99/206] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:54 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:54.739100 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-243d8f57-b7b3-4d8e-baad-e57c4fcbba03 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:54.747067 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-243d8f57-b7b3-4d8e-baad-e57c4fcbba03 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1363 microversion: 2.1 time: 0.174797 Sep 13 03:21:54.747841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 108/207] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:54 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:54.891373 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d98d4277-7e44-4d26-ba49-4112481b1a7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:54.891990 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d98d4277-7e44-4d26-ba49-4112481b1a7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:54.898451 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d98d4277-7e44-4d26-ba49-4112481b1a7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:54.899009 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d98d4277-7e44-4d26-ba49-4112481b1a7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:54.899457 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d98d4277-7e44-4d26-ba49-4112481b1a7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:54.900157 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d98d4277-7e44-4d26-ba49-4112481b1a7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:54.900647 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d98d4277-7e44-4d26-ba49-4112481b1a7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:54.901069 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d98d4277-7e44-4d26-ba49-4112481b1a7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:55.048951 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d98d4277-7e44-4d26-ba49-4112481b1a7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:55.057399 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d98d4277-7e44-4d26-ba49-4112481b1a7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.170382 Sep 13 03:21:55.058910 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 100/208] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:54 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:55.406364 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f59ec17c-8631-4271-adbf-0a99ac72527e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:55.407116 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f59ec17c-8631-4271-adbf-0a99ac72527e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:55.413527 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f59ec17c-8631-4271-adbf-0a99ac72527e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:55.414025 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f59ec17c-8631-4271-adbf-0a99ac72527e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:55.414462 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f59ec17c-8631-4271-adbf-0a99ac72527e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:55.415185 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f59ec17c-8631-4271-adbf-0a99ac72527e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:55.415639 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f59ec17c-8631-4271-adbf-0a99ac72527e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:55.416062 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f59ec17c-8631-4271-adbf-0a99ac72527e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:55.445857 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ede13c8d-3dd9-4331-94e8-8643460f2154 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:55.446701 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ede13c8d-3dd9-4331-94e8-8643460f2154 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:55.453317 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ede13c8d-3dd9-4331-94e8-8643460f2154 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:55.453811 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ede13c8d-3dd9-4331-94e8-8643460f2154 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:55.454245 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ede13c8d-3dd9-4331-94e8-8643460f2154 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:55.461275 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ede13c8d-3dd9-4331-94e8-8643460f2154 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:55.461924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ede13c8d-3dd9-4331-94e8-8643460f2154 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:55.462531 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ede13c8d-3dd9-4331-94e8-8643460f2154 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:55.601090 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f59ec17c-8631-4271-adbf-0a99ac72527e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:55.622145 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f59ec17c-8631-4271-adbf-0a99ac72527e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.219399 Sep 13 03:21:55.627299 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ede13c8d-3dd9-4331-94e8-8643460f2154 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:55.639519 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ede13c8d-3dd9-4331-94e8-8643460f2154 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:55.641504 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ede13c8d-3dd9-4331-94e8-8643460f2154 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:55.643819 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ede13c8d-3dd9-4331-94e8-8643460f2154 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.201664 Sep 13 03:21:55.647589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 109/209] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:55 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:55.659922 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 101/210] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:55 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:55.665434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4560459a-4904-473d-8685-0329ca14782c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:55.666973 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4560459a-4904-473d-8685-0329ca14782c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:55.670839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b6fe6b38-b859-49c4-877f-b12b729c826c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:55.671824 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b6fe6b38-b859-49c4-877f-b12b729c826c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:55.675299 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=100 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:55.683153 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4560459a-4904-473d-8685-0329ca14782c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:55.684028 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4560459a-4904-473d-8685-0329ca14782c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:55.684864 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4560459a-4904-473d-8685-0329ca14782c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:55.687417 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4560459a-4904-473d-8685-0329ca14782c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:55.688110 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4560459a-4904-473d-8685-0329ca14782c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:55.688940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4560459a-4904-473d-8685-0329ca14782c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:55.701941 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6fe6b38-b859-49c4-877f-b12b729c826c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:55.702441 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6fe6b38-b859-49c4-877f-b12b729c826c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:55.702964 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6fe6b38-b859-49c4-877f-b12b729c826c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:55.703860 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6fe6b38-b859-49c4-877f-b12b729c826c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:55.704467 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6fe6b38-b859-49c4-877f-b12b729c826c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:55.705041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6fe6b38-b859-49c4-877f-b12b729c826c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:56.095360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4560459a-4904-473d-8685-0329ca14782c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:56.105131 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4560459a-4904-473d-8685-0329ca14782c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.453259 Sep 13 03:21:56.118633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 110/211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:55 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:56.124064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cee22768-4036-43a5-ac66-913b31a038d8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:56.124697 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-cee22768-4036-43a5-ac66-913b31a038d8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:56.132552 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cee22768-4036-43a5-ac66-913b31a038d8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:56.134696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cee22768-4036-43a5-ac66-913b31a038d8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:56.135220 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cee22768-4036-43a5-ac66-913b31a038d8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:56.136091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cee22768-4036-43a5-ac66-913b31a038d8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:56.136564 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cee22768-4036-43a5-ac66-913b31a038d8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:56.136990 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cee22768-4036-43a5-ac66-913b31a038d8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:56.202694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b6fe6b38-b859-49c4-877f-b12b729c826c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:56.212697 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b6fe6b38-b859-49c4-877f-b12b729c826c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.551492 Sep 13 03:21:56.213659 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 102/212] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:55 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:56.218316 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-ca2102a3-740e-4c2e-8acb-0c43013a9ae9 req-b02d9a81-a3fd-497c-8281-6537fb9b6c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97f011a-6370-474e-9a62-e9229eb7d7ee", "name": "network-vif-plugged", "status": "completed", "tag": "1c922edb-7dd6-4a91-ba67-004272056f1c"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:56.228417 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-ca2102a3-740e-4c2e-8acb-0c43013a9ae9 req-b02d9a81-a3fd-497c-8281-6537fb9b6c8d service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:56.228985 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-ca2102a3-740e-4c2e-8acb-0c43013a9ae9 req-b02d9a81-a3fd-497c-8281-6537fb9b6c8d service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:56.229607 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-ca2102a3-740e-4c2e-8acb-0c43013a9ae9 req-b02d9a81-a3fd-497c-8281-6537fb9b6c8d service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:56.240641 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-ca2102a3-740e-4c2e-8acb-0c43013a9ae9 req-b02d9a81-a3fd-497c-8281-6537fb9b6c8d service nova] Creating event network-vif-plugged:1c922edb-7dd6-4a91-ba67-004272056f1c for instance a97f011a-6370-474e-9a62-e9229eb7d7ee on hv-cinder-85707 Sep 13 03:21:56.245616 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-ca2102a3-740e-4c2e-8acb-0c43013a9ae9 req-b02d9a81-a3fd-497c-8281-6537fb9b6c8d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030635 Sep 13 03:21:56.246213 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 103/213] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:21:56.251398 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1bdec076-e994-4e6c-94b9-6a2b5a741ed7 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:56.252093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-1bdec076-e994-4e6c-94b9-6a2b5a741ed7 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:56.258254 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1bdec076-e994-4e6c-94b9-6a2b5a741ed7 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:56.258781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1bdec076-e994-4e6c-94b9-6a2b5a741ed7 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:56.259221 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1bdec076-e994-4e6c-94b9-6a2b5a741ed7 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:56.259915 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1bdec076-e994-4e6c-94b9-6a2b5a741ed7 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:56.260376 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1bdec076-e994-4e6c-94b9-6a2b5a741ed7 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:56.260970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1bdec076-e994-4e6c-94b9-6a2b5a741ed7 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:56.265284 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=100 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:56.296956 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-cee22768-4036-43a5-ac66-913b31a038d8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:56.306752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-cee22768-4036-43a5-ac66-913b31a038d8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1548 microversion: 2.1 time: 0.199425 Sep 13 03:21:56.307972 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 111/214] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:56 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1548 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:56.329048 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0c38c041-1115-4dc6-bf38-6cd1ad95a6f0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:56.329540 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0c38c041-1115-4dc6-bf38-6cd1ad95a6f0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:56.336503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0c38c041-1115-4dc6-bf38-6cd1ad95a6f0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:56.337114 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0c38c041-1115-4dc6-bf38-6cd1ad95a6f0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:56.337411 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0c38c041-1115-4dc6-bf38-6cd1ad95a6f0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:56.338095 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0c38c041-1115-4dc6-bf38-6cd1ad95a6f0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:56.338549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0c38c041-1115-4dc6-bf38-6cd1ad95a6f0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:56.339005 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0c38c041-1115-4dc6-bf38-6cd1ad95a6f0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:56.422200 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-1bdec076-e994-4e6c-94b9-6a2b5a741ed7 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:56.431692 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1bdec076-e994-4e6c-94b9-6a2b5a741ed7 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.184299 Sep 13 03:21:56.442655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 104/215] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:56 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:56.458577 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0c38c041-1115-4dc6-bf38-6cd1ad95a6f0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133229 Sep 13 03:21:56.459193 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 112/216] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 03:21:56 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:21:56.668629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ad1bce03-137a-4b6d-a4f8-17e29fc45163 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:56.669556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ad1bce03-137a-4b6d-a4f8-17e29fc45163 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:56.671876 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a9d3aa78-95af-461d-85a3-c9983f326b3f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:56.673143 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a9d3aa78-95af-461d-85a3-c9983f326b3f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:56.676081 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ad1bce03-137a-4b6d-a4f8-17e29fc45163 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:56.676968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ad1bce03-137a-4b6d-a4f8-17e29fc45163 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:56.677564 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ad1bce03-137a-4b6d-a4f8-17e29fc45163 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:56.678463 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ad1bce03-137a-4b6d-a4f8-17e29fc45163 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:56.679085 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ad1bce03-137a-4b6d-a4f8-17e29fc45163 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:56.679673 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ad1bce03-137a-4b6d-a4f8-17e29fc45163 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:56.680702 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a9d3aa78-95af-461d-85a3-c9983f326b3f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:56.681382 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a9d3aa78-95af-461d-85a3-c9983f326b3f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:56.681898 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a9d3aa78-95af-461d-85a3-c9983f326b3f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:56.682596 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a9d3aa78-95af-461d-85a3-c9983f326b3f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:56.683069 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a9d3aa78-95af-461d-85a3-c9983f326b3f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:56.683682 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a9d3aa78-95af-461d-85a3-c9983f326b3f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:56.848263 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a9d3aa78-95af-461d-85a3-c9983f326b3f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:56.858548 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a9d3aa78-95af-461d-85a3-c9983f326b3f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.200409 Sep 13 03:21:56.871727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 105/217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:56 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:56.911073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ad1bce03-137a-4b6d-a4f8-17e29fc45163 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:56.942964 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ad1bce03-137a-4b6d-a4f8-17e29fc45163 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:56.945166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ad1bce03-137a-4b6d-a4f8-17e29fc45163 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:56.946785 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ad1bce03-137a-4b6d-a4f8-17e29fc45163 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.282223 Sep 13 03:21:56.947604 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 113/218] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:56 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:21:57.131459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-291f694d-0809-48d1-9004-18b6889f9412 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:57.132000 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-291f694d-0809-48d1-9004-18b6889f9412 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:57.138431 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-291f694d-0809-48d1-9004-18b6889f9412 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:57.138983 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-291f694d-0809-48d1-9004-18b6889f9412 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:57.139730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-291f694d-0809-48d1-9004-18b6889f9412 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:57.141048 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-291f694d-0809-48d1-9004-18b6889f9412 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:57.141642 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-291f694d-0809-48d1-9004-18b6889f9412 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:57.142101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-291f694d-0809-48d1-9004-18b6889f9412 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:57.246135 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e35cc7c1-6e90-4606-9e68-be0af332e601 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:57.246916 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e35cc7c1-6e90-4606-9e68-be0af332e601 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:57.255071 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e35cc7c1-6e90-4606-9e68-be0af332e601 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:57.255969 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e35cc7c1-6e90-4606-9e68-be0af332e601 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:57.256793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e35cc7c1-6e90-4606-9e68-be0af332e601 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:57.258008 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e35cc7c1-6e90-4606-9e68-be0af332e601 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:57.258744 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e35cc7c1-6e90-4606-9e68-be0af332e601 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:57.259519 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e35cc7c1-6e90-4606-9e68-be0af332e601 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:57.296737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-291f694d-0809-48d1-9004-18b6889f9412 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:57.306157 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-291f694d-0809-48d1-9004-18b6889f9412 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.180426 Sep 13 03:21:57.310804 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 106/219] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:57 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:57.456852 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-12e66164-380e-496a-b910-2fb02257c356 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:57.457762 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-12e66164-380e-496a-b910-2fb02257c356 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:57.468422 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-12e66164-380e-496a-b910-2fb02257c356 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:57.470199 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-12e66164-380e-496a-b910-2fb02257c356 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:57.470728 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-12e66164-380e-496a-b910-2fb02257c356 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:57.471509 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-12e66164-380e-496a-b910-2fb02257c356 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:57.471989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-12e66164-380e-496a-b910-2fb02257c356 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:57.473016 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-12e66164-380e-496a-b910-2fb02257c356 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:57.591938 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e35cc7c1-6e90-4606-9e68-be0af332e601 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:57.603937 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e35cc7c1-6e90-4606-9e68-be0af332e601 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.362299 Sep 13 03:21:57.605176 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 114/220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:57 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:57.648834 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-12e66164-380e-496a-b910-2fb02257c356 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:57.657235 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-12e66164-380e-496a-b910-2fb02257c356 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.204830 Sep 13 03:21:57.657806 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 107/221] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:57 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:57.891073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6a115ea7-faaf-4301-a85b-1ddefe7b99ab tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:57.892199 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6a115ea7-faaf-4301-a85b-1ddefe7b99ab tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:57.899883 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a115ea7-faaf-4301-a85b-1ddefe7b99ab tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:57.900901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a115ea7-faaf-4301-a85b-1ddefe7b99ab tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:57.901496 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a115ea7-faaf-4301-a85b-1ddefe7b99ab tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:57.902373 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a115ea7-faaf-4301-a85b-1ddefe7b99ab tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:57.903012 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a115ea7-faaf-4301-a85b-1ddefe7b99ab tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:57.903600 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a115ea7-faaf-4301-a85b-1ddefe7b99ab tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:57.981967 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-45cc790b-5452-466a-b767-d04c91dc3e12 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:57.983156 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-45cc790b-5452-466a-b767-d04c91dc3e12 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:57.992573 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-45cc790b-5452-466a-b767-d04c91dc3e12 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:57.993321 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-45cc790b-5452-466a-b767-d04c91dc3e12 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:57.993942 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-45cc790b-5452-466a-b767-d04c91dc3e12 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:57.994864 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-45cc790b-5452-466a-b767-d04c91dc3e12 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:57.995671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-45cc790b-5452-466a-b767-d04c91dc3e12 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:57.997428 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-45cc790b-5452-466a-b767-d04c91dc3e12 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:58.150300 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6a115ea7-faaf-4301-a85b-1ddefe7b99ab tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:58.160180 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-45cc790b-5452-466a-b767-d04c91dc3e12 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:58.171731 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-45cc790b-5452-466a-b767-d04c91dc3e12 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:58.174584 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-45cc790b-5452-466a-b767-d04c91dc3e12 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:58.175972 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-45cc790b-5452-466a-b767-d04c91dc3e12 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.205259 Sep 13 03:21:58.176688 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 108/222] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:57 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:58.188294 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6a115ea7-faaf-4301-a85b-1ddefe7b99ab tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.299289 Sep 13 03:21:58.191717 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 115/223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:57 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:58.246558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-db4a9dcc-c6b1-49e9-8056-b57208904966 req-36bd72f8-704f-458a-b87d-e0000602e658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81", "tag": "5e1eb65a-db49-4f23-a402-182f179922bc"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:21:58.258696 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-db4a9dcc-c6b1-49e9-8056-b57208904966 req-36bd72f8-704f-458a-b87d-e0000602e658 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:58.259184 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-db4a9dcc-c6b1-49e9-8056-b57208904966 req-36bd72f8-704f-458a-b87d-e0000602e658 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:58.259617 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-db4a9dcc-c6b1-49e9-8056-b57208904966 req-36bd72f8-704f-458a-b87d-e0000602e658 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:58.274073 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-db4a9dcc-c6b1-49e9-8056-b57208904966 req-36bd72f8-704f-458a-b87d-e0000602e658 service nova] Creating event network-changed:5e1eb65a-db49-4f23-a402-182f179922bc for instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 on hv-cinder-85707 Sep 13 03:21:58.279923 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-db4a9dcc-c6b1-49e9-8056-b57208904966 req-36bd72f8-704f-458a-b87d-e0000602e658 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038031 Sep 13 03:21:58.283930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 109/224] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:21:58.331293 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-71702644-4ece-440f-a7ac-df687f19f652 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:58.332576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-71702644-4ece-440f-a7ac-df687f19f652 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:58.342473 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-71702644-4ece-440f-a7ac-df687f19f652 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:58.343297 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-71702644-4ece-440f-a7ac-df687f19f652 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:58.344481 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-71702644-4ece-440f-a7ac-df687f19f652 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:58.345427 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-71702644-4ece-440f-a7ac-df687f19f652 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:58.347139 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-71702644-4ece-440f-a7ac-df687f19f652 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:58.347740 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-71702644-4ece-440f-a7ac-df687f19f652 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:58.566076 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-71702644-4ece-440f-a7ac-df687f19f652 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:58.575672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-71702644-4ece-440f-a7ac-df687f19f652 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.249791 Sep 13 03:21:58.588065 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 116/225] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:58 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:58.644941 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7b3f65dd-0fe7-4bc2-87b3-8b9d93111d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:58.645634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7b3f65dd-0fe7-4bc2-87b3-8b9d93111d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:58.651782 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7b3f65dd-0fe7-4bc2-87b3-8b9d93111d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:58.652204 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7b3f65dd-0fe7-4bc2-87b3-8b9d93111d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:58.652634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7b3f65dd-0fe7-4bc2-87b3-8b9d93111d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:58.653448 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7b3f65dd-0fe7-4bc2-87b3-8b9d93111d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:58.653744 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7b3f65dd-0fe7-4bc2-87b3-8b9d93111d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:58.654329 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7b3f65dd-0fe7-4bc2-87b3-8b9d93111d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:58.684244 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-253a0f7d-5524-4ed9-bca7-e15b4d811880 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:58.685333 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-253a0f7d-5524-4ed9-bca7-e15b4d811880 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:58.693792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-253a0f7d-5524-4ed9-bca7-e15b4d811880 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:58.694590 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-253a0f7d-5524-4ed9-bca7-e15b4d811880 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:58.695297 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-253a0f7d-5524-4ed9-bca7-e15b4d811880 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:58.696335 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-253a0f7d-5524-4ed9-bca7-e15b4d811880 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:58.697180 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-253a0f7d-5524-4ed9-bca7-e15b4d811880 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:58.700057 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-253a0f7d-5524-4ed9-bca7-e15b4d811880 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:58.812135 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7b3f65dd-0fe7-4bc2-87b3-8b9d93111d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:58.822730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7b3f65dd-0fe7-4bc2-87b3-8b9d93111d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.182135 Sep 13 03:21:58.823309 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 110/226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:58 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:58.877253 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-253a0f7d-5524-4ed9-bca7-e15b4d811880 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:58.886635 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-253a0f7d-5524-4ed9-bca7-e15b4d811880 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1315 microversion: 2.1 time: 0.207618 Sep 13 03:21:58.895252 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 117/227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:58 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:59.210124 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d6aad6ec-9a1c-4524-8fb3-dcf9358797a9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:59.210866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d6aad6ec-9a1c-4524-8fb3-dcf9358797a9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:59.213901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-06a848c9-33aa-4145-984c-6d753888e81f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:59.214729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-06a848c9-33aa-4145-984c-6d753888e81f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:59.224149 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06a848c9-33aa-4145-984c-6d753888e81f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:59.225973 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6aad6ec-9a1c-4524-8fb3-dcf9358797a9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:59.226491 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6aad6ec-9a1c-4524-8fb3-dcf9358797a9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:59.226840 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06a848c9-33aa-4145-984c-6d753888e81f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:59.226958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6aad6ec-9a1c-4524-8fb3-dcf9358797a9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:59.227608 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6aad6ec-9a1c-4524-8fb3-dcf9358797a9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:59.228060 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6aad6ec-9a1c-4524-8fb3-dcf9358797a9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:59.228389 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06a848c9-33aa-4145-984c-6d753888e81f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:59.228504 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6aad6ec-9a1c-4524-8fb3-dcf9358797a9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:59.235774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06a848c9-33aa-4145-984c-6d753888e81f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:59.236487 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06a848c9-33aa-4145-984c-6d753888e81f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:59.237087 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06a848c9-33aa-4145-984c-6d753888e81f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:59.276990 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:59.508066 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d6aad6ec-9a1c-4524-8fb3-dcf9358797a9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:59.531084 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-06a848c9-33aa-4145-984c-6d753888e81f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:59.532833 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d6aad6ec-9a1c-4524-8fb3-dcf9358797a9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:59.534293 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d6aad6ec-9a1c-4524-8fb3-dcf9358797a9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:59.535959 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d6aad6ec-9a1c-4524-8fb3-dcf9358797a9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.331398 Sep 13 03:21:59.540379 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-06a848c9-33aa-4145-984c-6d753888e81f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.331089 Sep 13 03:21:59.541492 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 118/228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:59 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:21:59.546206 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 111/229] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:21:59 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:21:59.608273 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4d04ee8c-c5e2-45b8-b2ac-863e5db66e83 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:59.608978 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4d04ee8c-c5e2-45b8-b2ac-863e5db66e83 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:59.622830 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4d04ee8c-c5e2-45b8-b2ac-863e5db66e83 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:59.623336 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4d04ee8c-c5e2-45b8-b2ac-863e5db66e83 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:59.623796 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4d04ee8c-c5e2-45b8-b2ac-863e5db66e83 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:59.624507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4d04ee8c-c5e2-45b8-b2ac-863e5db66e83 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:59.624961 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4d04ee8c-c5e2-45b8-b2ac-863e5db66e83 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:59.625382 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4d04ee8c-c5e2-45b8-b2ac-863e5db66e83 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:59.789222 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4d04ee8c-c5e2-45b8-b2ac-863e5db66e83 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:21:59.817122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4d04ee8c-c5e2-45b8-b2ac-863e5db66e83 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.209389 Sep 13 03:21:59.818230 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 119/230] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:59 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:21:59.845663 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-57ada52b-ebc7-407e-8411-760e178c42fa tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:59.846293 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-57ada52b-ebc7-407e-8411-760e178c42fa tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:59.854194 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-57ada52b-ebc7-407e-8411-760e178c42fa tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:59.854715 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-57ada52b-ebc7-407e-8411-760e178c42fa tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:59.855156 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-57ada52b-ebc7-407e-8411-760e178c42fa tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:59.855859 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-57ada52b-ebc7-407e-8411-760e178c42fa tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:59.856317 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-57ada52b-ebc7-407e-8411-760e178c42fa tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:59.856742 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-57ada52b-ebc7-407e-8411-760e178c42fa tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:59.912557 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-aae243bb-773b-43ca-bcaa-aa8b3f083942 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:21:59.913166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-aae243bb-773b-43ca-bcaa-aa8b3f083942 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:21:59.925070 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-aae243bb-773b-43ca-bcaa-aa8b3f083942 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:59.925624 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-aae243bb-773b-43ca-bcaa-aa8b3f083942 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:59.927707 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-aae243bb-773b-43ca-bcaa-aa8b3f083942 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:21:59.930068 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-aae243bb-773b-43ca-bcaa-aa8b3f083942 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:21:59.930765 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-aae243bb-773b-43ca-bcaa-aa8b3f083942 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:21:59.931384 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-aae243bb-773b-43ca-bcaa-aa8b3f083942 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:00.108012 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-57ada52b-ebc7-407e-8411-760e178c42fa tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:00.116729 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-57ada52b-ebc7-407e-8411-760e178c42fa tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.275109 Sep 13 03:22:00.128639 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-aae243bb-773b-43ca-bcaa-aa8b3f083942 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:00.132442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 112/231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:59 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:00.136892 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-aae243bb-773b-43ca-bcaa-aa8b3f083942 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1501 microversion: 2.1 time: 0.229027 Sep 13 03:22:00.137833 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 120/232] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:21:59 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1501 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:00.570453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c8c89414-3b88-4c49-bd44-6a5174c4ff10 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:00.571080 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c8c89414-3b88-4c49-bd44-6a5174c4ff10 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:00.577372 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c8c89414-3b88-4c49-bd44-6a5174c4ff10 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:00.577748 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c8c89414-3b88-4c49-bd44-6a5174c4ff10 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:00.578175 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c8c89414-3b88-4c49-bd44-6a5174c4ff10 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:00.578920 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c8c89414-3b88-4c49-bd44-6a5174c4ff10 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:00.579363 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c8c89414-3b88-4c49-bd44-6a5174c4ff10 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:00.579788 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c8c89414-3b88-4c49-bd44-6a5174c4ff10 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:00.580715 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c5916b21-f698-4a8e-8450-4389e264e049 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:00.581416 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c5916b21-f698-4a8e-8450-4389e264e049 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:00.589622 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c5916b21-f698-4a8e-8450-4389e264e049 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:00.590376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c5916b21-f698-4a8e-8450-4389e264e049 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:00.590925 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c5916b21-f698-4a8e-8450-4389e264e049 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:00.591671 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c5916b21-f698-4a8e-8450-4389e264e049 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:00.592135 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c5916b21-f698-4a8e-8450-4389e264e049 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:00.592566 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c5916b21-f698-4a8e-8450-4389e264e049 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:00.729102 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c8c89414-3b88-4c49-bd44-6a5174c4ff10 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:00.740594 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c5916b21-f698-4a8e-8450-4389e264e049 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:00.744633 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c8c89414-3b88-4c49-bd44-6a5174c4ff10 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:00.746094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c8c89414-3b88-4c49-bd44-6a5174c4ff10 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:00.747239 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c8c89414-3b88-4c49-bd44-6a5174c4ff10 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.181169 Sep 13 03:22:00.747802 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 113/233] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:22:00 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:22:00.760849 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c5916b21-f698-4a8e-8450-4389e264e049 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.184171 Sep 13 03:22:00.765786 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 121/234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:00 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:00.842543 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9017f02f-ea2a-45d8-acb6-c16b0c8abad1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:00.843318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9017f02f-ea2a-45d8-acb6-c16b0c8abad1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:00.850010 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9017f02f-ea2a-45d8-acb6-c16b0c8abad1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:00.850559 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9017f02f-ea2a-45d8-acb6-c16b0c8abad1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:00.850920 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9017f02f-ea2a-45d8-acb6-c16b0c8abad1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:00.851698 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9017f02f-ea2a-45d8-acb6-c16b0c8abad1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:00.852168 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9017f02f-ea2a-45d8-acb6-c16b0c8abad1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:00.852472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9017f02f-ea2a-45d8-acb6-c16b0c8abad1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:00.983113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9017f02f-ea2a-45d8-acb6-c16b0c8abad1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:00.991570 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9017f02f-ea2a-45d8-acb6-c16b0c8abad1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.152921 Sep 13 03:22:00.992221 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 114/235] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:00 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:01.140852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-11a03a64-086d-4e73-94ed-514da919e2dd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:01.141695 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-11a03a64-086d-4e73-94ed-514da919e2dd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:01.148226 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-11a03a64-086d-4e73-94ed-514da919e2dd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:01.149020 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-11a03a64-086d-4e73-94ed-514da919e2dd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:01.149913 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-11a03a64-086d-4e73-94ed-514da919e2dd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:01.150716 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-11a03a64-086d-4e73-94ed-514da919e2dd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:01.151553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-11a03a64-086d-4e73-94ed-514da919e2dd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:01.152336 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-11a03a64-086d-4e73-94ed-514da919e2dd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:01.282518 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-11a03a64-086d-4e73-94ed-514da919e2dd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:01.290987 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-11a03a64-086d-4e73-94ed-514da919e2dd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.155500 Sep 13 03:22:01.291555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 122/236] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:01 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:01.606347 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0b16bfa3-eb15-46a7-974d-186b37211223 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56d79a05-a97a-4c24-ba82-f93473fea47a"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:22:01.608989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0b16bfa3-eb15-46a7-974d-186b37211223 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:01.615040 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0b16bfa3-eb15-46a7-974d-186b37211223 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:01.615528 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0b16bfa3-eb15-46a7-974d-186b37211223 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:01.615965 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0b16bfa3-eb15-46a7-974d-186b37211223 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:01.616657 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0b16bfa3-eb15-46a7-974d-186b37211223 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:01.617120 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0b16bfa3-eb15-46a7-974d-186b37211223 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:01.617545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0b16bfa3-eb15-46a7-974d-186b37211223 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:01.772449 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-18a1d399-9789-4b9f-9da3-4c17a21bd411 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:01.773056 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-18a1d399-9789-4b9f-9da3-4c17a21bd411 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:01.779251 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18a1d399-9789-4b9f-9da3-4c17a21bd411 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:01.779750 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18a1d399-9789-4b9f-9da3-4c17a21bd411 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:01.780218 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18a1d399-9789-4b9f-9da3-4c17a21bd411 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:01.780887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18a1d399-9789-4b9f-9da3-4c17a21bd411 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:01.782004 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18a1d399-9789-4b9f-9da3-4c17a21bd411 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:01.782004 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18a1d399-9789-4b9f-9da3-4c17a21bd411 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:01.912840 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-18a1d399-9789-4b9f-9da3-4c17a21bd411 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:01.921015 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-18a1d399-9789-4b9f-9da3-4c17a21bd411 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:01.922461 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-18a1d399-9789-4b9f-9da3-4c17a21bd411 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:01.923607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-18a1d399-9789-4b9f-9da3-4c17a21bd411 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.155670 Sep 13 03:22:01.924172 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 123/237] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:22:01 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:22:01.928534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f93f38d2-2406-44f8-9ffa-ecfec41f8690 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:01.929143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f93f38d2-2406-44f8-9ffa-ecfec41f8690 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:01.935006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f93f38d2-2406-44f8-9ffa-ecfec41f8690 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:01.935496 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f93f38d2-2406-44f8-9ffa-ecfec41f8690 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:01.935931 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f93f38d2-2406-44f8-9ffa-ecfec41f8690 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:01.936617 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f93f38d2-2406-44f8-9ffa-ecfec41f8690 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:01.937075 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f93f38d2-2406-44f8-9ffa-ecfec41f8690 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:01.937498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f93f38d2-2406-44f8-9ffa-ecfec41f8690 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:02.067260 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f93f38d2-2406-44f8-9ffa-ecfec41f8690 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:02.075227 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f93f38d2-2406-44f8-9ffa-ecfec41f8690 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.150105 Sep 13 03:22:02.075800 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 124/238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:01 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:02.080233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b317664c-2776-43a7-9d84-35d5ec6b9b95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:02.080861 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b317664c-2776-43a7-9d84-35d5ec6b9b95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:02.087277 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b317664c-2776-43a7-9d84-35d5ec6b9b95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:02.087762 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b317664c-2776-43a7-9d84-35d5ec6b9b95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:02.088192 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b317664c-2776-43a7-9d84-35d5ec6b9b95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:02.088919 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b317664c-2776-43a7-9d84-35d5ec6b9b95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:02.090002 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b317664c-2776-43a7-9d84-35d5ec6b9b95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:02.090602 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b317664c-2776-43a7-9d84-35d5ec6b9b95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:02.241567 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b317664c-2776-43a7-9d84-35d5ec6b9b95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:02.254894 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b317664c-2776-43a7-9d84-35d5ec6b9b95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.176659 Sep 13 03:22:02.255678 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 125/239] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:02 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:02.262213 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-6142bdfe-b1c0-4786-baf2-9466a7994af6 req-67c6f252-4924-447e-9d1a-15a17b37023c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab865ad-8ee0-4def-a996-caa5e4e30f30", "name": "network-vif-plugged", "status": "completed", "tag": "99e3ee84-e44d-466c-bb25-da0a34a04a5e"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:22:02.276279 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6142bdfe-b1c0-4786-baf2-9466a7994af6 req-67c6f252-4924-447e-9d1a-15a17b37023c service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:02.276762 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6142bdfe-b1c0-4786-baf2-9466a7994af6 req-67c6f252-4924-447e-9d1a-15a17b37023c service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:02.277199 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6142bdfe-b1c0-4786-baf2-9466a7994af6 req-67c6f252-4924-447e-9d1a-15a17b37023c service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:02.290599 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-6142bdfe-b1c0-4786-baf2-9466a7994af6 req-67c6f252-4924-447e-9d1a-15a17b37023c service nova] Creating event network-vif-plugged:99e3ee84-e44d-466c-bb25-da0a34a04a5e for instance dab865ad-8ee0-4def-a996-caa5e4e30f30 on hv-cinder-85707 Sep 13 03:22:02.296438 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-6142bdfe-b1c0-4786-baf2-9466a7994af6 req-67c6f252-4924-447e-9d1a-15a17b37023c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038880 Sep 13 03:22:02.298479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 126/240] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:22:02.315178 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e2ea676c-7254-45b1-af09-0d1815ea68ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:02.316558 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e2ea676c-7254-45b1-af09-0d1815ea68ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:02.322871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e2ea676c-7254-45b1-af09-0d1815ea68ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:02.323433 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e2ea676c-7254-45b1-af09-0d1815ea68ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:02.323935 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e2ea676c-7254-45b1-af09-0d1815ea68ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:02.324696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e2ea676c-7254-45b1-af09-0d1815ea68ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:02.325285 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e2ea676c-7254-45b1-af09-0d1815ea68ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:02.325723 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e2ea676c-7254-45b1-af09-0d1815ea68ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:02.460333 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e2ea676c-7254-45b1-af09-0d1815ea68ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:02.468655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e2ea676c-7254-45b1-af09-0d1815ea68ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.157531 Sep 13 03:22:02.469398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 127/241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:02 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:02.949368 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b0eb4011-cf6f-4b73-a01d-0dde13aab8f6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:02.949976 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b0eb4011-cf6f-4b73-a01d-0dde13aab8f6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:02.955880 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0eb4011-cf6f-4b73-a01d-0dde13aab8f6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:02.956897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0eb4011-cf6f-4b73-a01d-0dde13aab8f6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:02.957319 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0eb4011-cf6f-4b73-a01d-0dde13aab8f6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:02.957998 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0eb4011-cf6f-4b73-a01d-0dde13aab8f6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:02.958451 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0eb4011-cf6f-4b73-a01d-0dde13aab8f6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:02.958895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0eb4011-cf6f-4b73-a01d-0dde13aab8f6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:03.095441 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b0eb4011-cf6f-4b73-a01d-0dde13aab8f6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:03.104408 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b0eb4011-cf6f-4b73-a01d-0dde13aab8f6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:03.105909 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b0eb4011-cf6f-4b73-a01d-0dde13aab8f6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:03.107044 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b0eb4011-cf6f-4b73-a01d-0dde13aab8f6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.162322 Sep 13 03:22:03.107594 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 128/242] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:22:02 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:22:03.112766 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a8e44294-3e6e-49ed-8349-2bceb5ed3df8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:03.112766 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a8e44294-3e6e-49ed-8349-2bceb5ed3df8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:03.118207 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a8e44294-3e6e-49ed-8349-2bceb5ed3df8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:03.118729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a8e44294-3e6e-49ed-8349-2bceb5ed3df8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:03.119159 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a8e44294-3e6e-49ed-8349-2bceb5ed3df8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:03.119855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a8e44294-3e6e-49ed-8349-2bceb5ed3df8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:03.120308 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a8e44294-3e6e-49ed-8349-2bceb5ed3df8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:03.120730 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a8e44294-3e6e-49ed-8349-2bceb5ed3df8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:03.559862 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a8e44294-3e6e-49ed-8349-2bceb5ed3df8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:03.567994 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a8e44294-3e6e-49ed-8349-2bceb5ed3df8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.459397 Sep 13 03:22:03.568553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 129/243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:03 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:03.572918 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4be7a1cf-49a2-4afd-903f-c70bac242863 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:03.573532 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4be7a1cf-49a2-4afd-903f-c70bac242863 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:03.582996 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4be7a1cf-49a2-4afd-903f-c70bac242863 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:03.583596 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4be7a1cf-49a2-4afd-903f-c70bac242863 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:03.584020 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4be7a1cf-49a2-4afd-903f-c70bac242863 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:03.584710 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4be7a1cf-49a2-4afd-903f-c70bac242863 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:03.585160 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4be7a1cf-49a2-4afd-903f-c70bac242863 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:03.585578 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4be7a1cf-49a2-4afd-903f-c70bac242863 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:03.717922 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4be7a1cf-49a2-4afd-903f-c70bac242863 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:03.725526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4be7a1cf-49a2-4afd-903f-c70bac242863 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.156038 Sep 13 03:22:03.726088 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 130/244] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:03 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:03.730427 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-627c9a75-45ec-4204-94c4-b047ef0fbe89 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:03.731049 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-627c9a75-45ec-4204-94c4-b047ef0fbe89 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:03.736521 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-627c9a75-45ec-4204-94c4-b047ef0fbe89 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:03.737002 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-627c9a75-45ec-4204-94c4-b047ef0fbe89 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:03.737431 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-627c9a75-45ec-4204-94c4-b047ef0fbe89 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:03.738788 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-627c9a75-45ec-4204-94c4-b047ef0fbe89 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:03.739241 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-627c9a75-45ec-4204-94c4-b047ef0fbe89 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:03.739669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-627c9a75-45ec-4204-94c4-b047ef0fbe89 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:03.873369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-627c9a75-45ec-4204-94c4-b047ef0fbe89 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:03.882083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-627c9a75-45ec-4204-94c4-b047ef0fbe89 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.155060 Sep 13 03:22:03.882655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 131/245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:03 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:04.133381 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-76ae49a3-f24b-40bb-ae50-c3165ee43db6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:04.134410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-76ae49a3-f24b-40bb-ae50-c3165ee43db6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:04.141002 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76ae49a3-f24b-40bb-ae50-c3165ee43db6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:04.141706 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76ae49a3-f24b-40bb-ae50-c3165ee43db6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:04.142146 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76ae49a3-f24b-40bb-ae50-c3165ee43db6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:04.142942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76ae49a3-f24b-40bb-ae50-c3165ee43db6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:04.143400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76ae49a3-f24b-40bb-ae50-c3165ee43db6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:04.143906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76ae49a3-f24b-40bb-ae50-c3165ee43db6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:04.307700 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-76ae49a3-f24b-40bb-ae50-c3165ee43db6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:04.318107 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-76ae49a3-f24b-40bb-ae50-c3165ee43db6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:04.319562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-76ae49a3-f24b-40bb-ae50-c3165ee43db6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:04.320892 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-76ae49a3-f24b-40bb-ae50-c3165ee43db6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.192788 Sep 13 03:22:04.334721 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 132/246] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:22:04 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:22:04.591795 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4cb80bbb-ef0d-481d-b5d9-d018f8bd815a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:04.592473 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4cb80bbb-ef0d-481d-b5d9-d018f8bd815a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:04.599879 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4cb80bbb-ef0d-481d-b5d9-d018f8bd815a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:04.600503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4cb80bbb-ef0d-481d-b5d9-d018f8bd815a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:04.600968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4cb80bbb-ef0d-481d-b5d9-d018f8bd815a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:04.601933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4cb80bbb-ef0d-481d-b5d9-d018f8bd815a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:04.602445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4cb80bbb-ef0d-481d-b5d9-d018f8bd815a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:04.602900 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4cb80bbb-ef0d-481d-b5d9-d018f8bd815a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:04.754020 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4cb80bbb-ef0d-481d-b5d9-d018f8bd815a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:04.763737 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4cb80bbb-ef0d-481d-b5d9-d018f8bd815a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.176387 Sep 13 03:22:04.764403 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 133/247] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:04 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:04.769085 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-20ad41c6-823d-47ec-9961-145d6c478ba9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:04.769801 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-20ad41c6-823d-47ec-9961-145d6c478ba9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:04.773166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:04.777056 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-20ad41c6-823d-47ec-9961-145d6c478ba9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:04.777676 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-20ad41c6-823d-47ec-9961-145d6c478ba9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:04.778140 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-20ad41c6-823d-47ec-9961-145d6c478ba9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:04.778936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-20ad41c6-823d-47ec-9961-145d6c478ba9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:04.779608 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-20ad41c6-823d-47ec-9961-145d6c478ba9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:04.780107 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-20ad41c6-823d-47ec-9961-145d6c478ba9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:04.919006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-20ad41c6-823d-47ec-9961-145d6c478ba9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:04.927787 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-20ad41c6-823d-47ec-9961-145d6c478ba9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.162225 Sep 13 03:22:04.928863 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 134/248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:04 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:04.933575 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ecd97c97-ab9b-4931-b4ed-d5f9230dcbb3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:04.934168 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ecd97c97-ab9b-4931-b4ed-d5f9230dcbb3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:04.939749 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ecd97c97-ab9b-4931-b4ed-d5f9230dcbb3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:04.940413 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ecd97c97-ab9b-4931-b4ed-d5f9230dcbb3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:04.940842 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ecd97c97-ab9b-4931-b4ed-d5f9230dcbb3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:04.941520 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ecd97c97-ab9b-4931-b4ed-d5f9230dcbb3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:04.942019 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ecd97c97-ab9b-4931-b4ed-d5f9230dcbb3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:04.942437 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ecd97c97-ab9b-4931-b4ed-d5f9230dcbb3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:05.099024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ecd97c97-ab9b-4931-b4ed-d5f9230dcbb3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:05.102458 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:05.107530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ecd97c97-ab9b-4931-b4ed-d5f9230dcbb3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.177547 Sep 13 03:22:05.108102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 135/249] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:04 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:05.346540 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7edc7397-3946-495e-a4ec-2f16ca7f2f91 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:05.347189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7edc7397-3946-495e-a4ec-2f16ca7f2f91 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:05.353635 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7edc7397-3946-495e-a4ec-2f16ca7f2f91 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:05.354126 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7edc7397-3946-495e-a4ec-2f16ca7f2f91 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:05.354556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7edc7397-3946-495e-a4ec-2f16ca7f2f91 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:05.355265 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7edc7397-3946-495e-a4ec-2f16ca7f2f91 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:05.355717 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7edc7397-3946-495e-a4ec-2f16ca7f2f91 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:05.356135 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7edc7397-3946-495e-a4ec-2f16ca7f2f91 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:05.498802 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7edc7397-3946-495e-a4ec-2f16ca7f2f91 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:05.507294 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7edc7397-3946-495e-a4ec-2f16ca7f2f91 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:05.508752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7edc7397-3946-495e-a4ec-2f16ca7f2f91 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:05.509943 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7edc7397-3946-495e-a4ec-2f16ca7f2f91 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.167202 Sep 13 03:22:05.510514 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 136/250] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:22:05 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:22:05.790712 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-75cef90d-2e6d-4683-8a56-a179fd76836e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:05.791494 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-75cef90d-2e6d-4683-8a56-a179fd76836e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:05.809194 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-75cef90d-2e6d-4683-8a56-a179fd76836e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:05.809773 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-75cef90d-2e6d-4683-8a56-a179fd76836e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:05.812042 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-75cef90d-2e6d-4683-8a56-a179fd76836e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:05.815467 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-75cef90d-2e6d-4683-8a56-a179fd76836e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:05.818010 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-75cef90d-2e6d-4683-8a56-a179fd76836e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:05.819120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-75cef90d-2e6d-4683-8a56-a179fd76836e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:05.975177 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-75cef90d-2e6d-4683-8a56-a179fd76836e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:05.983139 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-75cef90d-2e6d-4683-8a56-a179fd76836e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.198368 Sep 13 03:22:05.983719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 137/251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:05 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:06.003108 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3f08bb4e-822e-4f90-a851-41e4127c34cb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:06.003760 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3f08bb4e-822e-4f90-a851-41e4127c34cb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:06.010132 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f08bb4e-822e-4f90-a851-41e4127c34cb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:06.010644 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f08bb4e-822e-4f90-a851-41e4127c34cb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:06.011092 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f08bb4e-822e-4f90-a851-41e4127c34cb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:06.011789 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f08bb4e-822e-4f90-a851-41e4127c34cb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:06.012407 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f08bb4e-822e-4f90-a851-41e4127c34cb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:06.013042 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f08bb4e-822e-4f90-a851-41e4127c34cb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:06.148918 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3f08bb4e-822e-4f90-a851-41e4127c34cb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:06.159367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3f08bb4e-822e-4f90-a851-41e4127c34cb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.159960 Sep 13 03:22:06.160103 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 138/252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:05 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:06.165174 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3bc8b824-4504-42c1-be17-028509fc17b9 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:06.165885 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3bc8b824-4504-42c1-be17-028509fc17b9 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:06.179660 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3bc8b824-4504-42c1-be17-028509fc17b9 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:06.180274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3bc8b824-4504-42c1-be17-028509fc17b9 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:06.180776 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3bc8b824-4504-42c1-be17-028509fc17b9 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:06.181545 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3bc8b824-4504-42c1-be17-028509fc17b9 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:06.182070 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3bc8b824-4504-42c1-be17-028509fc17b9 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:06.182568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3bc8b824-4504-42c1-be17-028509fc17b9 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:06.331032 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3bc8b824-4504-42c1-be17-028509fc17b9 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:06.352002 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3bc8b824-4504-42c1-be17-028509fc17b9 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.188613 Sep 13 03:22:06.354629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 139/253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:06 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:06.412250 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-6b005f65-f004-46ef-8e12-083a32c5f627 req-08e6546b-f275-406e-b3b8-9796bd60b3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c384f0-cb60-4c77-94da-1c9b8055f3fe", "name": "network-vif-plugged", "status": "completed", "tag": "cd68b0ee-f68a-44d9-87ad-66638f02cae6"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:22:06.422928 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6b005f65-f004-46ef-8e12-083a32c5f627 req-08e6546b-f275-406e-b3b8-9796bd60b3e4 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:06.423411 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6b005f65-f004-46ef-8e12-083a32c5f627 req-08e6546b-f275-406e-b3b8-9796bd60b3e4 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:06.423982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6b005f65-f004-46ef-8e12-083a32c5f627 req-08e6546b-f275-406e-b3b8-9796bd60b3e4 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:06.438360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-6b005f65-f004-46ef-8e12-083a32c5f627 req-08e6546b-f275-406e-b3b8-9796bd60b3e4 service nova] Creating event network-vif-plugged:cd68b0ee-f68a-44d9-87ad-66638f02cae6 for instance 01c384f0-cb60-4c77-94da-1c9b8055f3fe on hv-cinder-85707 Sep 13 03:22:06.445574 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-6b005f65-f004-46ef-8e12-083a32c5f627 req-08e6546b-f275-406e-b3b8-9796bd60b3e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041744 Sep 13 03:22:06.446712 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 140/254] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:22:06.535451 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4b431b6c-402e-4fe2-9547-b00e3f240d6b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:06.536417 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4b431b6c-402e-4fe2-9547-b00e3f240d6b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:06.542830 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b431b6c-402e-4fe2-9547-b00e3f240d6b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:06.543316 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b431b6c-402e-4fe2-9547-b00e3f240d6b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:06.543756 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b431b6c-402e-4fe2-9547-b00e3f240d6b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:06.544733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b431b6c-402e-4fe2-9547-b00e3f240d6b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:06.545169 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b431b6c-402e-4fe2-9547-b00e3f240d6b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:06.545590 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b431b6c-402e-4fe2-9547-b00e3f240d6b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:06.551685 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0b16bfa3-eb15-46a7-974d-186b37211223 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "POST /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.948512 Sep 13 03:22:06.557873 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 115/255] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:22:01 2022] POST /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332/os-volume_attachments => generated 194 bytes in 4951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:22:06.684385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4b431b6c-402e-4fe2-9547-b00e3f240d6b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:06.693293 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4b431b6c-402e-4fe2-9547-b00e3f240d6b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:06.694980 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4b431b6c-402e-4fe2-9547-b00e3f240d6b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:06.696097 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4b431b6c-402e-4fe2-9547-b00e3f240d6b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.164965 Sep 13 03:22:06.696660 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 141/256] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:22:06 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:22:07.006037 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f52233bd-8eb8-41e4-a585-2a8916a61599 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:07.006755 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f52233bd-8eb8-41e4-a585-2a8916a61599 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:07.013017 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f52233bd-8eb8-41e4-a585-2a8916a61599 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:07.013504 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f52233bd-8eb8-41e4-a585-2a8916a61599 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:07.013943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f52233bd-8eb8-41e4-a585-2a8916a61599 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:07.014664 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f52233bd-8eb8-41e4-a585-2a8916a61599 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:07.015126 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f52233bd-8eb8-41e4-a585-2a8916a61599 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:07.015551 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f52233bd-8eb8-41e4-a585-2a8916a61599 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:07.185345 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-393410fc-e2cd-4a79-a3da-5703d9c6fcf1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:07.186028 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-393410fc-e2cd-4a79-a3da-5703d9c6fcf1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:07.193892 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-393410fc-e2cd-4a79-a3da-5703d9c6fcf1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:07.194188 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-393410fc-e2cd-4a79-a3da-5703d9c6fcf1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:07.194648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-393410fc-e2cd-4a79-a3da-5703d9c6fcf1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:07.205657 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-393410fc-e2cd-4a79-a3da-5703d9c6fcf1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:07.206149 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-393410fc-e2cd-4a79-a3da-5703d9c6fcf1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:07.206594 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-393410fc-e2cd-4a79-a3da-5703d9c6fcf1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:07.276071 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f52233bd-8eb8-41e4-a585-2a8916a61599 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:07.286671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f52233bd-8eb8-41e4-a585-2a8916a61599 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.285228 Sep 13 03:22:07.287496 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 116/257] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:07 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:07.364569 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-393410fc-e2cd-4a79-a3da-5703d9c6fcf1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:07.372270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-393410fc-e2cd-4a79-a3da-5703d9c6fcf1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.190844 Sep 13 03:22:07.372833 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 142/258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:07 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:07.379792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-50541629-0a26-4381-8adc-6612ecbad523 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:07.380553 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-50541629-0a26-4381-8adc-6612ecbad523 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:07.386971 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50541629-0a26-4381-8adc-6612ecbad523 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:07.387653 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50541629-0a26-4381-8adc-6612ecbad523 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:07.388089 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50541629-0a26-4381-8adc-6612ecbad523 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:07.388784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50541629-0a26-4381-8adc-6612ecbad523 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:07.389240 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50541629-0a26-4381-8adc-6612ecbad523 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:07.389663 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50541629-0a26-4381-8adc-6612ecbad523 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:07.518601 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-50541629-0a26-4381-8adc-6612ecbad523 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:07.527311 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-50541629-0a26-4381-8adc-6612ecbad523 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.151349 Sep 13 03:22:07.527884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 117/259] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:07 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:07.721380 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a53afd6b-f632-4bce-b43d-ac8c5417b04f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:07.722054 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a53afd6b-f632-4bce-b43d-ac8c5417b04f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:07.729693 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a53afd6b-f632-4bce-b43d-ac8c5417b04f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:07.730188 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a53afd6b-f632-4bce-b43d-ac8c5417b04f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:07.730672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a53afd6b-f632-4bce-b43d-ac8c5417b04f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:07.731380 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a53afd6b-f632-4bce-b43d-ac8c5417b04f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:07.731835 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a53afd6b-f632-4bce-b43d-ac8c5417b04f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:07.732260 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a53afd6b-f632-4bce-b43d-ac8c5417b04f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:07.876238 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a53afd6b-f632-4bce-b43d-ac8c5417b04f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:07.885855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a53afd6b-f632-4bce-b43d-ac8c5417b04f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:07.888198 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a53afd6b-f632-4bce-b43d-ac8c5417b04f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:07.889295 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a53afd6b-f632-4bce-b43d-ac8c5417b04f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1408 microversion: 2.20 time: 0.173237 Sep 13 03:22:07.890415 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 143/260] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:22:07 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:22:08.309338 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-04b5e948-4123-4bbf-a9a4-018f6a74e993 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:08.309985 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-04b5e948-4123-4bbf-a9a4-018f6a74e993 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:08.316572 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04b5e948-4123-4bbf-a9a4-018f6a74e993 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:08.317563 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04b5e948-4123-4bbf-a9a4-018f6a74e993 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:08.317999 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04b5e948-4123-4bbf-a9a4-018f6a74e993 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:08.318719 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04b5e948-4123-4bbf-a9a4-018f6a74e993 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:08.319341 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04b5e948-4123-4bbf-a9a4-018f6a74e993 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:08.319766 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04b5e948-4123-4bbf-a9a4-018f6a74e993 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:08.394915 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9ded4339-5ebe-469a-970f-e9ed0d055904 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:08.395450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9ded4339-5ebe-469a-970f-e9ed0d055904 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:08.405129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9ded4339-5ebe-469a-970f-e9ed0d055904 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:08.405741 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9ded4339-5ebe-469a-970f-e9ed0d055904 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:08.406286 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9ded4339-5ebe-469a-970f-e9ed0d055904 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:08.407126 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9ded4339-5ebe-469a-970f-e9ed0d055904 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:08.408940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9ded4339-5ebe-469a-970f-e9ed0d055904 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:08.412329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9ded4339-5ebe-469a-970f-e9ed0d055904 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:08.459806 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-04b5e948-4123-4bbf-a9a4-018f6a74e993 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:08.468047 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-04b5e948-4123-4bbf-a9a4-018f6a74e993 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.162630 Sep 13 03:22:08.468968 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 118/261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:08 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:08.554521 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3cd3ebc9-42a2-41c5-994e-626f4d89cd09 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:08.555774 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3cd3ebc9-42a2-41c5-994e-626f4d89cd09 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:08.560127 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9ded4339-5ebe-469a-970f-e9ed0d055904 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:08.570427 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9ded4339-5ebe-469a-970f-e9ed0d055904 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.178365 Sep 13 03:22:08.571408 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 144/262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:08 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:08.590071 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3cd3ebc9-42a2-41c5-994e-626f4d89cd09 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:08.590569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3cd3ebc9-42a2-41c5-994e-626f4d89cd09 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:08.593725 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3cd3ebc9-42a2-41c5-994e-626f4d89cd09 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:08.594305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3cd3ebc9-42a2-41c5-994e-626f4d89cd09 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:08.594798 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3cd3ebc9-42a2-41c5-994e-626f4d89cd09 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:08.595218 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3cd3ebc9-42a2-41c5-994e-626f4d89cd09 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:08.764100 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3cd3ebc9-42a2-41c5-994e-626f4d89cd09 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:08.773393 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3cd3ebc9-42a2-41c5-994e-626f4d89cd09 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1366 microversion: 2.1 time: 0.224821 Sep 13 03:22:08.773997 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 119/263] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:08 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:08.914810 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-465f7de7-d143-460c-a181-7b5e5fce3287 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:08.915422 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-465f7de7-d143-460c-a181-7b5e5fce3287 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:08.921547 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-465f7de7-d143-460c-a181-7b5e5fce3287 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:08.922031 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-465f7de7-d143-460c-a181-7b5e5fce3287 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:08.922464 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-465f7de7-d143-460c-a181-7b5e5fce3287 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:08.923175 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-465f7de7-d143-460c-a181-7b5e5fce3287 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:08.923626 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-465f7de7-d143-460c-a181-7b5e5fce3287 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:08.924047 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-465f7de7-d143-460c-a181-7b5e5fce3287 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:09.052988 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-465f7de7-d143-460c-a181-7b5e5fce3287 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:09.061128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-465f7de7-d143-460c-a181-7b5e5fce3287 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:09.062590 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-465f7de7-d143-460c-a181-7b5e5fce3287 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:09.063780 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-465f7de7-d143-460c-a181-7b5e5fce3287 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1599 microversion: 2.20 time: 0.152920 Sep 13 03:22:09.064696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 145/264] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:22:08 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:22:09.089775 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-66b6aa58-203b-49d6-a9db-dced779a8d73 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:09.090263 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-66b6aa58-203b-49d6-a9db-dced779a8d73 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:09.096022 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66b6aa58-203b-49d6-a9db-dced779a8d73 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:09.096504 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66b6aa58-203b-49d6-a9db-dced779a8d73 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:09.096932 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66b6aa58-203b-49d6-a9db-dced779a8d73 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:09.097613 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66b6aa58-203b-49d6-a9db-dced779a8d73 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:09.098064 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66b6aa58-203b-49d6-a9db-dced779a8d73 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:09.098484 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66b6aa58-203b-49d6-a9db-dced779a8d73 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:09.102228 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:09.176700 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-66b6aa58-203b-49d6-a9db-dced779a8d73 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090175 Sep 13 03:22:09.177286 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 120/265] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Sep 13 03:22:09 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:22:09.492514 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3eda841a-6dcc-4b92-9c3b-17e63a95e143 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:09.493148 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3eda841a-6dcc-4b92-9c3b-17e63a95e143 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:09.498908 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3eda841a-6dcc-4b92-9c3b-17e63a95e143 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:09.499388 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3eda841a-6dcc-4b92-9c3b-17e63a95e143 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:09.499821 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3eda841a-6dcc-4b92-9c3b-17e63a95e143 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:09.500507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3eda841a-6dcc-4b92-9c3b-17e63a95e143 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:09.500956 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3eda841a-6dcc-4b92-9c3b-17e63a95e143 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:09.501373 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3eda841a-6dcc-4b92-9c3b-17e63a95e143 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:09.600797 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-75baf43a-c822-4745-8ec7-813b142e5c88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:09.602105 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-75baf43a-c822-4745-8ec7-813b142e5c88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:09.611321 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-75baf43a-c822-4745-8ec7-813b142e5c88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:09.612257 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-75baf43a-c822-4745-8ec7-813b142e5c88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:09.613049 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-75baf43a-c822-4745-8ec7-813b142e5c88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:09.614182 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-75baf43a-c822-4745-8ec7-813b142e5c88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:09.615198 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-75baf43a-c822-4745-8ec7-813b142e5c88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:09.615891 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-75baf43a-c822-4745-8ec7-813b142e5c88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:09.685743 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3eda841a-6dcc-4b92-9c3b-17e63a95e143 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:09.693989 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3eda841a-6dcc-4b92-9c3b-17e63a95e143 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.205759 Sep 13 03:22:09.694577 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 146/266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:09 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:09.796284 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-376eab4f-a899-4a20-94a7-5714172fa554 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:09.797898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-376eab4f-a899-4a20-94a7-5714172fa554 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:09.807716 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-376eab4f-a899-4a20-94a7-5714172fa554 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:09.808215 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-376eab4f-a899-4a20-94a7-5714172fa554 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:09.808648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-376eab4f-a899-4a20-94a7-5714172fa554 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:09.810837 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-376eab4f-a899-4a20-94a7-5714172fa554 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:09.811329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-376eab4f-a899-4a20-94a7-5714172fa554 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:09.811928 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-376eab4f-a899-4a20-94a7-5714172fa554 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:09.975278 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-376eab4f-a899-4a20-94a7-5714172fa554 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:09.992455 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-376eab4f-a899-4a20-94a7-5714172fa554 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1556 microversion: 2.1 time: 0.199774 Sep 13 03:22:09.993648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 147/267] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:09 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1556 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:10.016032 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ae087757-bb76-4cfb-8858-26436fcdb175 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:10.016661 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ae087757-bb76-4cfb-8858-26436fcdb175 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:10.023747 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae087757-bb76-4cfb-8858-26436fcdb175 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:10.024491 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae087757-bb76-4cfb-8858-26436fcdb175 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:10.025026 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae087757-bb76-4cfb-8858-26436fcdb175 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:10.025815 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae087757-bb76-4cfb-8858-26436fcdb175 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:10.026493 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae087757-bb76-4cfb-8858-26436fcdb175 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:10.027206 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae087757-bb76-4cfb-8858-26436fcdb175 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:10.119586 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ae087757-bb76-4cfb-8858-26436fcdb175 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107314 Sep 13 03:22:10.120447 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 148/268] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 03:22:10 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:22:10.128326 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-75baf43a-c822-4745-8ec7-813b142e5c88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:10.136195 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-75baf43a-c822-4745-8ec7-813b142e5c88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.540486 Sep 13 03:22:10.136774 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 121/269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:09 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:10.724263 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-3bbdacc0-5f61-4a89-a9b0-62ce59f583be req-bb78b7cf-8a21-4ae0-b792-c28f90f163fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0445581f-c40d-4838-864c-bb080dcf594b", "name": "network-vif-plugged", "status": "completed", "tag": "f18a4265-4277-4b61-a45f-eca4e86395c8"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:22:10.725124 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3c1d01cb-3b11-40f7-bb3e-e8b9cb878037 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:10.726641 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3c1d01cb-3b11-40f7-bb3e-e8b9cb878037 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:10.732888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3c1d01cb-3b11-40f7-bb3e-e8b9cb878037 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:10.733380 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3c1d01cb-3b11-40f7-bb3e-e8b9cb878037 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:10.733815 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3c1d01cb-3b11-40f7-bb3e-e8b9cb878037 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:10.734514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3c1d01cb-3b11-40f7-bb3e-e8b9cb878037 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:10.745580 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-3bbdacc0-5f61-4a89-a9b0-62ce59f583be req-bb78b7cf-8a21-4ae0-b792-c28f90f163fb service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:10.746065 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-3bbdacc0-5f61-4a89-a9b0-62ce59f583be req-bb78b7cf-8a21-4ae0-b792-c28f90f163fb service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:10.746796 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-3bbdacc0-5f61-4a89-a9b0-62ce59f583be req-bb78b7cf-8a21-4ae0-b792-c28f90f163fb service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:10.748645 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3c1d01cb-3b11-40f7-bb3e-e8b9cb878037 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:10.750025 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3c1d01cb-3b11-40f7-bb3e-e8b9cb878037 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:10.781452 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-3bbdacc0-5f61-4a89-a9b0-62ce59f583be req-bb78b7cf-8a21-4ae0-b792-c28f90f163fb service nova] Creating event network-vif-plugged:f18a4265-4277-4b61-a45f-eca4e86395c8 for instance 0445581f-c40d-4838-864c-bb080dcf594b on hv-cinder-85707 Sep 13 03:22:10.802036 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-3bbdacc0-5f61-4a89-a9b0-62ce59f583be req-bb78b7cf-8a21-4ae0-b792-c28f90f163fb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092934 Sep 13 03:22:10.803033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 149/270] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:22:11.161052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-69fe1aa9-4877-4302-8f8e-fd326ae194b2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:11.162289 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-69fe1aa9-4877-4302-8f8e-fd326ae194b2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:11.168648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-69fe1aa9-4877-4302-8f8e-fd326ae194b2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:11.169379 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-69fe1aa9-4877-4302-8f8e-fd326ae194b2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:11.169817 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-69fe1aa9-4877-4302-8f8e-fd326ae194b2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:11.170513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-69fe1aa9-4877-4302-8f8e-fd326ae194b2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:11.170984 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-69fe1aa9-4877-4302-8f8e-fd326ae194b2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:11.171405 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-69fe1aa9-4877-4302-8f8e-fd326ae194b2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:11.313859 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3c1d01cb-3b11-40f7-bb3e-e8b9cb878037 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:11.317466 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-69fe1aa9-4877-4302-8f8e-fd326ae194b2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:11.327397 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3c1d01cb-3b11-40f7-bb3e-e8b9cb878037 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.613249 Sep 13 03:22:11.338905 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 122/271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:10 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:11.339920 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-69fe1aa9-4877-4302-8f8e-fd326ae194b2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.169162 Sep 13 03:22:11.339920 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 150/272] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:11 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:11.409521 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-f8a725b5-3174-4cf8-88df-1e182f27017e req-016737d5-6a0f-41f7-9a74-26e37a733bec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97f011a-6370-474e-9a62-e9229eb7d7ee", "tag": "1c922edb-7dd6-4a91-ba67-004272056f1c"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:22:11.420088 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-f8a725b5-3174-4cf8-88df-1e182f27017e req-016737d5-6a0f-41f7-9a74-26e37a733bec service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:11.420584 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-f8a725b5-3174-4cf8-88df-1e182f27017e req-016737d5-6a0f-41f7-9a74-26e37a733bec service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:11.421089 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-f8a725b5-3174-4cf8-88df-1e182f27017e req-016737d5-6a0f-41f7-9a74-26e37a733bec service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:11.432296 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-f8a725b5-3174-4cf8-88df-1e182f27017e req-016737d5-6a0f-41f7-9a74-26e37a733bec service nova] Creating event network-changed:1c922edb-7dd6-4a91-ba67-004272056f1c for instance a97f011a-6370-474e-9a62-e9229eb7d7ee on hv-cinder-85707 Sep 13 03:22:11.437352 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-f8a725b5-3174-4cf8-88df-1e182f27017e req-016737d5-6a0f-41f7-9a74-26e37a733bec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031711 Sep 13 03:22:11.438211 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 123/273] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:22:12.353863 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c8c1ce82-fc71-404e-bed8-a0da16e7206b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:12.354726 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c8c1ce82-fc71-404e-bed8-a0da16e7206b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:12.356322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f676e1af-7c2a-4f81-b371-aa4a980dcd26 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:12.357638 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f676e1af-7c2a-4f81-b371-aa4a980dcd26 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:12.361645 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c8c1ce82-fc71-404e-bed8-a0da16e7206b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:12.362917 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c8c1ce82-fc71-404e-bed8-a0da16e7206b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:12.364435 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c8c1ce82-fc71-404e-bed8-a0da16e7206b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:12.365221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c8c1ce82-fc71-404e-bed8-a0da16e7206b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:12.365751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c8c1ce82-fc71-404e-bed8-a0da16e7206b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:12.366249 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f676e1af-7c2a-4f81-b371-aa4a980dcd26 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:12.366942 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f676e1af-7c2a-4f81-b371-aa4a980dcd26 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:12.367586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f676e1af-7c2a-4f81-b371-aa4a980dcd26 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:12.368377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f676e1af-7c2a-4f81-b371-aa4a980dcd26 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:12.368914 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f676e1af-7c2a-4f81-b371-aa4a980dcd26 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:12.369437 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f676e1af-7c2a-4f81-b371-aa4a980dcd26 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:12.373368 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c8c1ce82-fc71-404e-bed8-a0da16e7206b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:12.604796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f676e1af-7c2a-4f81-b371-aa4a980dcd26 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:12.617743 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f676e1af-7c2a-4f81-b371-aa4a980dcd26 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1318 microversion: 2.1 time: 0.267872 Sep 13 03:22:12.618350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 124/274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:12 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:12.869479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c8c1ce82-fc71-404e-bed8-a0da16e7206b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:12.876969 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c8c1ce82-fc71-404e-bed8-a0da16e7206b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.527459 Sep 13 03:22:12.877523 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 151/275] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:12 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:13.456174 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-0a6f64a5-4d24-44cd-970b-1b24eb620063 req-0b400dd9-7eee-4f9d-8bef-120153de5298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab865ad-8ee0-4def-a996-caa5e4e30f30", "tag": "99e3ee84-e44d-466c-bb25-da0a34a04a5e"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:22:13.466017 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-0a6f64a5-4d24-44cd-970b-1b24eb620063 req-0b400dd9-7eee-4f9d-8bef-120153de5298 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:13.466481 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-0a6f64a5-4d24-44cd-970b-1b24eb620063 req-0b400dd9-7eee-4f9d-8bef-120153de5298 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:13.466938 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-0a6f64a5-4d24-44cd-970b-1b24eb620063 req-0b400dd9-7eee-4f9d-8bef-120153de5298 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:13.477695 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-0a6f64a5-4d24-44cd-970b-1b24eb620063 req-0b400dd9-7eee-4f9d-8bef-120153de5298 service nova] Creating event network-changed:99e3ee84-e44d-466c-bb25-da0a34a04a5e for instance dab865ad-8ee0-4def-a996-caa5e4e30f30 on hv-cinder-85707 Sep 13 03:22:13.482644 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-0a6f64a5-4d24-44cd-970b-1b24eb620063 req-0b400dd9-7eee-4f9d-8bef-120153de5298 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030098 Sep 13 03:22:13.483248 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 125/276] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:22:13.641499 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-de17bf34-a354-4e0b-8885-986deaeae84d tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:13.643230 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-de17bf34-a354-4e0b-8885-986deaeae84d tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:13.649644 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de17bf34-a354-4e0b-8885-986deaeae84d tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:13.650334 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de17bf34-a354-4e0b-8885-986deaeae84d tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:13.650788 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de17bf34-a354-4e0b-8885-986deaeae84d tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:13.651625 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de17bf34-a354-4e0b-8885-986deaeae84d tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:13.652232 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de17bf34-a354-4e0b-8885-986deaeae84d tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:13.652774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de17bf34-a354-4e0b-8885-986deaeae84d tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:13.789701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-de17bf34-a354-4e0b-8885-986deaeae84d tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:13.797824 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-de17bf34-a354-4e0b-8885-986deaeae84d tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1507 microversion: 2.1 time: 0.160075 Sep 13 03:22:13.798429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 152/277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:13 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:13.900534 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-20aa070c-ed58-4df2-a315-777a3d62ae32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:13.901398 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-20aa070c-ed58-4df2-a315-777a3d62ae32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:13.907986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-20aa070c-ed58-4df2-a315-777a3d62ae32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:13.908476 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-20aa070c-ed58-4df2-a315-777a3d62ae32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:13.909090 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-20aa070c-ed58-4df2-a315-777a3d62ae32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:13.909653 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-20aa070c-ed58-4df2-a315-777a3d62ae32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:13.910781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-20aa070c-ed58-4df2-a315-777a3d62ae32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:13.911470 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-20aa070c-ed58-4df2-a315-777a3d62ae32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:14.077027 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-20aa070c-ed58-4df2-a315-777a3d62ae32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:14.084762 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-20aa070c-ed58-4df2-a315-777a3d62ae32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.189044 Sep 13 03:22:14.085335 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 126/278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:13 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:15.108631 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-470db1f8-d73b-48b8-acf0-60f529a5fa88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:15.110291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-470db1f8-d73b-48b8-acf0-60f529a5fa88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:15.121405 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-470db1f8-d73b-48b8-acf0-60f529a5fa88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:15.121905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-470db1f8-d73b-48b8-acf0-60f529a5fa88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:15.123024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-470db1f8-d73b-48b8-acf0-60f529a5fa88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:15.123746 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-470db1f8-d73b-48b8-acf0-60f529a5fa88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:15.125762 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-470db1f8-d73b-48b8-acf0-60f529a5fa88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:15.126198 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-470db1f8-d73b-48b8-acf0-60f529a5fa88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:15.392132 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-470db1f8-d73b-48b8-acf0-60f529a5fa88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:15.400685 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-470db1f8-d73b-48b8-acf0-60f529a5fa88 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1322 microversion: 2.1 time: 0.296853 Sep 13 03:22:15.401259 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 153/279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:15 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:16.424215 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a5b88b78-3d2c-4984-9d31-3ab07523f377 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:16.424831 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a5b88b78-3d2c-4984-9d31-3ab07523f377 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:16.436644 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a5b88b78-3d2c-4984-9d31-3ab07523f377 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:16.437353 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a5b88b78-3d2c-4984-9d31-3ab07523f377 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:16.439087 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a5b88b78-3d2c-4984-9d31-3ab07523f377 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:16.439979 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a5b88b78-3d2c-4984-9d31-3ab07523f377 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:16.440616 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a5b88b78-3d2c-4984-9d31-3ab07523f377 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:16.441202 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a5b88b78-3d2c-4984-9d31-3ab07523f377 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:16.657680 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a5b88b78-3d2c-4984-9d31-3ab07523f377 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:16.667319 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a5b88b78-3d2c-4984-9d31-3ab07523f377 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1517 microversion: 2.1 time: 0.246916 Sep 13 03:22:16.668163 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 127/280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:16 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1517 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:16.694288 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1aed3644-f65f-4423-8e2b-d044e711fa5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:22:16.696623 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1aed3644-f65f-4423-8e2b-d044e711fa5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:16.703406 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1aed3644-f65f-4423-8e2b-d044e711fa5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:16.704353 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1aed3644-f65f-4423-8e2b-d044e711fa5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:16.704797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1aed3644-f65f-4423-8e2b-d044e711fa5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:16.705494 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1aed3644-f65f-4423-8e2b-d044e711fa5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:16.705978 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1aed3644-f65f-4423-8e2b-d044e711fa5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:16.706564 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1aed3644-f65f-4423-8e2b-d044e711fa5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:16.711983 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:16.734386 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-1aed3644-f65f-4423-8e2b-d044e711fa5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lazy-loading 'flavor' on Instance uuid 0445581f-c40d-4838-864c-bb080dcf594b {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:22:16.870182 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1aed3644-f65f-4423-8e2b-d044e711fa5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "POST /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b/action" status: 200 len: 32 microversion: 2.1 time: 0.180169 Sep 13 03:22:16.875317 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 154/281] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:22:16 2022] POST /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 03:22:16.889509 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c9fbfca7-ea76-4219-92b1-c44e5cffb280 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:16.890538 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c9fbfca7-ea76-4219-92b1-c44e5cffb280 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:16.901024 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c9fbfca7-ea76-4219-92b1-c44e5cffb280 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:16.902131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c9fbfca7-ea76-4219-92b1-c44e5cffb280 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:16.902886 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c9fbfca7-ea76-4219-92b1-c44e5cffb280 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:16.905637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c9fbfca7-ea76-4219-92b1-c44e5cffb280 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:16.906123 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c9fbfca7-ea76-4219-92b1-c44e5cffb280 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:16.906925 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c9fbfca7-ea76-4219-92b1-c44e5cffb280 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:17.104896 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c9fbfca7-ea76-4219-92b1-c44e5cffb280 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:17.112583 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c9fbfca7-ea76-4219-92b1-c44e5cffb280 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.236125 Sep 13 03:22:17.113153 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 128/282] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:16 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:18.136352 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1de74dbd-0639-464c-9eb0-987f811d61e0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:18.137067 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1de74dbd-0639-464c-9eb0-987f811d61e0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:18.143402 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1de74dbd-0639-464c-9eb0-987f811d61e0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:18.143893 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1de74dbd-0639-464c-9eb0-987f811d61e0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:18.144333 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1de74dbd-0639-464c-9eb0-987f811d61e0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:18.145041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1de74dbd-0639-464c-9eb0-987f811d61e0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:18.145495 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1de74dbd-0639-464c-9eb0-987f811d61e0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:18.145919 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1de74dbd-0639-464c-9eb0-987f811d61e0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:18.278832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1de74dbd-0639-464c-9eb0-987f811d61e0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:18.287155 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1de74dbd-0639-464c-9eb0-987f811d61e0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.155140 Sep 13 03:22:18.287718 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 155/283] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:18 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:19.314530 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ea318c2a-f7b0-4c94-a52c-b04dd7fb0ac8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:19.315240 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ea318c2a-f7b0-4c94-a52c-b04dd7fb0ac8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:19.324099 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ea318c2a-f7b0-4c94-a52c-b04dd7fb0ac8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:19.324658 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ea318c2a-f7b0-4c94-a52c-b04dd7fb0ac8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:19.325097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ea318c2a-f7b0-4c94-a52c-b04dd7fb0ac8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:19.325821 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ea318c2a-f7b0-4c94-a52c-b04dd7fb0ac8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:19.326284 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ea318c2a-f7b0-4c94-a52c-b04dd7fb0ac8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:19.326752 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ea318c2a-f7b0-4c94-a52c-b04dd7fb0ac8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:19.458428 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ea318c2a-f7b0-4c94-a52c-b04dd7fb0ac8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:19.466639 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ea318c2a-f7b0-4c94-a52c-b04dd7fb0ac8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.155959 Sep 13 03:22:19.467200 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 129/284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:19 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:20.489323 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-40edb37c-8040-432e-9164-7fe03dcff98f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:20.489935 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-40edb37c-8040-432e-9164-7fe03dcff98f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:20.501759 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40edb37c-8040-432e-9164-7fe03dcff98f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:20.504579 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40edb37c-8040-432e-9164-7fe03dcff98f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:20.506857 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40edb37c-8040-432e-9164-7fe03dcff98f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:20.512271 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40edb37c-8040-432e-9164-7fe03dcff98f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:20.513071 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40edb37c-8040-432e-9164-7fe03dcff98f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:20.513841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40edb37c-8040-432e-9164-7fe03dcff98f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:20.694721 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-40edb37c-8040-432e-9164-7fe03dcff98f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:20.704271 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-40edb37c-8040-432e-9164-7fe03dcff98f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.218919 Sep 13 03:22:20.707946 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 156/285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:20 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:21.695040 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-af25471b-1279-41d1-8560-848c0068ef7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:21.695716 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-af25471b-1279-41d1-8560-848c0068ef7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:21.701841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-af25471b-1279-41d1-8560-848c0068ef7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:21.702322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-af25471b-1279-41d1-8560-848c0068ef7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:21.703004 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-af25471b-1279-41d1-8560-848c0068ef7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:21.703692 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-af25471b-1279-41d1-8560-848c0068ef7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:21.704139 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-af25471b-1279-41d1-8560-848c0068ef7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:21.704563 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-af25471b-1279-41d1-8560-848c0068ef7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:21.731499 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-af25471b-1279-41d1-8560-848c0068ef7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:22:21.733496 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a093ce51-6ac4-4bd9-8f96-c7133ff747a8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:21.734109 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a093ce51-6ac4-4bd9-8f96-c7133ff747a8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:21.740871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a093ce51-6ac4-4bd9-8f96-c7133ff747a8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:21.741362 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a093ce51-6ac4-4bd9-8f96-c7133ff747a8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:21.741795 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a093ce51-6ac4-4bd9-8f96-c7133ff747a8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:21.742486 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a093ce51-6ac4-4bd9-8f96-c7133ff747a8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:21.743180 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a093ce51-6ac4-4bd9-8f96-c7133ff747a8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:21.744876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a093ce51-6ac4-4bd9-8f96-c7133ff747a8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:21.830554 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-af25471b-1279-41d1-8560-848c0068ef7b tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 204 len: 0 microversion: 2.1 time: 0.138873 Sep 13 03:22:21.831420 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 130/286] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:22:21 2022] DELETE /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:22:21.840878 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2ea1a655-1253-4117-9f71-0829f72fde70 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:21.841865 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2ea1a655-1253-4117-9f71-0829f72fde70 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:21.849736 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ea1a655-1253-4117-9f71-0829f72fde70 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:21.850382 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ea1a655-1253-4117-9f71-0829f72fde70 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:21.850774 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ea1a655-1253-4117-9f71-0829f72fde70 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:21.851588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ea1a655-1253-4117-9f71-0829f72fde70 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:21.851971 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ea1a655-1253-4117-9f71-0829f72fde70 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:21.852410 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ea1a655-1253-4117-9f71-0829f72fde70 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:21.903168 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a093ce51-6ac4-4bd9-8f96-c7133ff747a8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:21.911435 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a093ce51-6ac4-4bd9-8f96-c7133ff747a8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.182317 Sep 13 03:22:21.912275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 157/287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:21 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:21.986214 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2ea1a655-1253-4117-9f71-0829f72fde70 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:21.994517 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2ea1a655-1253-4117-9f71-0829f72fde70 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1553 microversion: 2.1 time: 0.157894 Sep 13 03:22:21.995129 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 131/288] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:21 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:22.934215 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2964a481-593e-488e-9922-fd2b446a7840 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:22.935074 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2964a481-593e-488e-9922-fd2b446a7840 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:22.941572 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2964a481-593e-488e-9922-fd2b446a7840 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:22.942083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2964a481-593e-488e-9922-fd2b446a7840 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:22.942566 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2964a481-593e-488e-9922-fd2b446a7840 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:22.943392 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2964a481-593e-488e-9922-fd2b446a7840 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:22.945808 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2964a481-593e-488e-9922-fd2b446a7840 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:22.946241 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2964a481-593e-488e-9922-fd2b446a7840 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:23.018022 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-67d4b5b7-dcd5-4352-9305-8af35cedb474 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:23.018859 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-67d4b5b7-dcd5-4352-9305-8af35cedb474 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:23.026969 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67d4b5b7-dcd5-4352-9305-8af35cedb474 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:23.027755 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67d4b5b7-dcd5-4352-9305-8af35cedb474 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:23.028009 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67d4b5b7-dcd5-4352-9305-8af35cedb474 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:23.028696 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67d4b5b7-dcd5-4352-9305-8af35cedb474 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:23.029195 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67d4b5b7-dcd5-4352-9305-8af35cedb474 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:23.029667 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67d4b5b7-dcd5-4352-9305-8af35cedb474 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:23.176305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-67d4b5b7-dcd5-4352-9305-8af35cedb474 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:23.184289 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-67d4b5b7-dcd5-4352-9305-8af35cedb474 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1553 microversion: 2.1 time: 0.170696 Sep 13 03:22:23.184860 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 132/289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:23 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:23.224915 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2964a481-593e-488e-9922-fd2b446a7840 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:23.232400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2964a481-593e-488e-9922-fd2b446a7840 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.302078 Sep 13 03:22:23.233005 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 158/290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:22 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:24.207036 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b6339082-34a7-48c8-a074-509c9041ed29 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:24.207857 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b6339082-34a7-48c8-a074-509c9041ed29 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:24.214247 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6339082-34a7-48c8-a074-509c9041ed29 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:24.214858 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6339082-34a7-48c8-a074-509c9041ed29 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:24.215367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6339082-34a7-48c8-a074-509c9041ed29 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:24.216065 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6339082-34a7-48c8-a074-509c9041ed29 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:24.216523 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6339082-34a7-48c8-a074-509c9041ed29 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:24.216945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6339082-34a7-48c8-a074-509c9041ed29 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:24.255660 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e226519f-ead1-4087-ae04-737a7eaf273f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:24.256266 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e226519f-ead1-4087-ae04-737a7eaf273f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:24.262457 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e226519f-ead1-4087-ae04-737a7eaf273f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:24.262962 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e226519f-ead1-4087-ae04-737a7eaf273f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:24.263435 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e226519f-ead1-4087-ae04-737a7eaf273f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:24.264125 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e226519f-ead1-4087-ae04-737a7eaf273f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:24.264615 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e226519f-ead1-4087-ae04-737a7eaf273f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:24.265026 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e226519f-ead1-4087-ae04-737a7eaf273f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:24.369697 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b6339082-34a7-48c8-a074-509c9041ed29 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:24.381824 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b6339082-34a7-48c8-a074-509c9041ed29 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1553 microversion: 2.1 time: 0.178542 Sep 13 03:22:24.395505 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 133/291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:24 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:24.401154 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e226519f-ead1-4087-ae04-737a7eaf273f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:24.411719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e226519f-ead1-4087-ae04-737a7eaf273f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.158727 Sep 13 03:22:24.412501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 159/292] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:24 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:25.405593 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4cea5168-c0df-4fa9-9626-6d1eb1375a56 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:25.406235 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-4cea5168-c0df-4fa9-9626-6d1eb1375a56 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:25.413267 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4cea5168-c0df-4fa9-9626-6d1eb1375a56 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:25.413760 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4cea5168-c0df-4fa9-9626-6d1eb1375a56 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:25.414200 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4cea5168-c0df-4fa9-9626-6d1eb1375a56 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:25.414925 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4cea5168-c0df-4fa9-9626-6d1eb1375a56 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:25.415384 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4cea5168-c0df-4fa9-9626-6d1eb1375a56 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:25.415811 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4cea5168-c0df-4fa9-9626-6d1eb1375a56 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:25.436125 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3016e0ab-4930-47c2-bdda-44b5eccbb25e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:25.436817 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3016e0ab-4930-47c2-bdda-44b5eccbb25e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:25.442717 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3016e0ab-4930-47c2-bdda-44b5eccbb25e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:25.443211 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3016e0ab-4930-47c2-bdda-44b5eccbb25e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:25.443643 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3016e0ab-4930-47c2-bdda-44b5eccbb25e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:25.444442 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3016e0ab-4930-47c2-bdda-44b5eccbb25e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:25.445113 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3016e0ab-4930-47c2-bdda-44b5eccbb25e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:25.445532 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3016e0ab-4930-47c2-bdda-44b5eccbb25e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:25.510829 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4cea5168-c0df-4fa9-9626-6d1eb1375a56 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:25.523170 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4cea5168-c0df-4fa9-9626-6d1eb1375a56 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1511 microversion: 2.1 time: 0.121153 Sep 13 03:22:25.526850 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 134/293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:25 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1511 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:25.642365 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3016e0ab-4930-47c2-bdda-44b5eccbb25e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:25.654938 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3016e0ab-4930-47c2-bdda-44b5eccbb25e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.222442 Sep 13 03:22:25.655725 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 160/294] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:25 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:25.823517 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-52fb6a41-cb09-4417-a3e9-8948c9a2cc33 req-94392db9-8f0b-4e91-888d-f078b25fd576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92a5fc3-da4f-47bf-ab5e-c9c275f38332", "name": "network-vif-deleted", "tag": "c44d8cab-cafe-42d0-9df1-25b1e426b401"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:22:25.829200 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:25.837198 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-52fb6a41-cb09-4417-a3e9-8948c9a2cc33 req-94392db9-8f0b-4e91-888d-f078b25fd576 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:25.837676 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-52fb6a41-cb09-4417-a3e9-8948c9a2cc33 req-94392db9-8f0b-4e91-888d-f078b25fd576 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:25.838153 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-52fb6a41-cb09-4417-a3e9-8948c9a2cc33 req-94392db9-8f0b-4e91-888d-f078b25fd576 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:25.862691 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-52fb6a41-cb09-4417-a3e9-8948c9a2cc33 req-94392db9-8f0b-4e91-888d-f078b25fd576 service nova] Creating event network-vif-deleted:c44d8cab-cafe-42d0-9df1-25b1e426b401 for instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 on hv-cinder-85707 Sep 13 03:22:25.869180 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-52fb6a41-cb09-4417-a3e9-8948c9a2cc33 req-94392db9-8f0b-4e91-888d-f078b25fd576 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049195 Sep 13 03:22:25.869811 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 135/295] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:22:26.547371 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:26.547980 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:26.554493 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:26.554953 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:26.555376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:26.556054 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:26.556507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:26.556924 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:26.587789 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:26.588271 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:26.588698 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:26.589133 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lazy-loading 'fault' on Instance uuid c92a5fc3-da4f-47bf-ab5e-c9c275f38332 {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:22:26.632270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616dd34b9fde4ed6b42ec22421ebb504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d5e604b12545a68da3655cb6b881c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:26.640377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-eea329b7-4092-49b6-852d-71377e96f6e4 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 200 len: 1351 microversion: 2.1 time: 0.097275 Sep 13 03:22:26.640953 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 161/296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:26 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:26.678828 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-09247aa5-c668-4647-b8d1-46b647bb6da7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:26.679555 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-09247aa5-c668-4647-b8d1-46b647bb6da7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:26.686102 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-09247aa5-c668-4647-b8d1-46b647bb6da7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:26.686582 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-09247aa5-c668-4647-b8d1-46b647bb6da7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:26.687038 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-09247aa5-c668-4647-b8d1-46b647bb6da7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:26.687715 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-09247aa5-c668-4647-b8d1-46b647bb6da7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:26.688163 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-09247aa5-c668-4647-b8d1-46b647bb6da7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:26.688580 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-09247aa5-c668-4647-b8d1-46b647bb6da7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:26.823675 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-09247aa5-c668-4647-b8d1-46b647bb6da7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:26.831278 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-09247aa5-c668-4647-b8d1-46b647bb6da7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.157194 Sep 13 03:22:26.831835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 136/297] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:26 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:27.663887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-42e3df6f-34c3-4717-8017-999bc8dc81ae tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:27.664497 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-42e3df6f-34c3-4717-8017-999bc8dc81ae tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:27.670849 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-42e3df6f-34c3-4717-8017-999bc8dc81ae tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:27.671329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-42e3df6f-34c3-4717-8017-999bc8dc81ae tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:27.671756 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-42e3df6f-34c3-4717-8017-999bc8dc81ae tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:27.672444 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-42e3df6f-34c3-4717-8017-999bc8dc81ae tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:27.672891 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-42e3df6f-34c3-4717-8017-999bc8dc81ae tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:27.673339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-42e3df6f-34c3-4717-8017-999bc8dc81ae tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:27.686164 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-42e3df6f-34c3-4717-8017-999bc8dc81ae tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] HTTP exception thrown: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-42e3df6f-34c3-4717-8017-999bc8dc81ae tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Request method failure captured: Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 HTTP/1.1 Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cj8VDPZhyQ6nFGU8uGM5i-Igq4NR3aZ2w67n2_4TPtShHDPY_VorsN9D3IWmBQgNfq2Ll8AZLP6fXWobWt7yMLeHiZHc0-jwjyrT5pTCVQiBoMmhgDsMlColoaU1bGji77Id-SdrorUlKAtPRNMtRMvtkd9TVodGkCIHr43LUxcO0 Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 53d5e604b12545a68da3655cb6b881c5 Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-DeleteServersTestJSON-653682344 Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:22:27.690655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:22:27.692530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53d5e604b12545a68da3655cb6b881c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53d5e604b12545a68da3655cb6b881c5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53d5e604b12545a68da3655cb6b881c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53d5e604b12545a68da3655cb6b881c5"}]}] Sep 13 03:22:27.692530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-DeleteServersTestJSON-653682344 Sep 13 03:22:27.692530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 53d5e604b12545a68da3655cb6b881c5 Sep 13 03:22:27.692530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-DeleteServersTestJSON-653682344 Sep 13 03:22:27.692530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-DeleteServersTestJSON-653682344-project Sep 13 03:22:27.692530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:22:27.692530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:22:27.692530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 616dd34b9fde4ed6b42ec22421ebb504 Sep 13 03:22:27.692530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-DeleteServersTestJSON-653682344-project Sep 13 03:22:27.692530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:22:27.692530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:27.692530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'c92a5fc3-da4f-47bf-ab5e-c9c275f38332'} Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:22:27.693247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:27.694672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:27.696064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-42e3df6f-34c3-4717-8017-999bc8dc81ae tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Returning 404 to user: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:22:27.696064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-42e3df6f-34c3-4717-8017-999bc8dc81ae tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 404 len: 111 microversion: 2.1 time: 0.032730 Sep 13 03:22:27.696064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 162/298] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:27 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:22:27.809999 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2e689121-91de-488f-80ae-d073e9212106 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:27.812144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2e689121-91de-488f-80ae-d073e9212106 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:27.818962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e689121-91de-488f-80ae-d073e9212106 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:27.819449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e689121-91de-488f-80ae-d073e9212106 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:27.819880 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e689121-91de-488f-80ae-d073e9212106 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:27.820735 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e689121-91de-488f-80ae-d073e9212106 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:27.821333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e689121-91de-488f-80ae-d073e9212106 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:27.821914 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e689121-91de-488f-80ae-d073e9212106 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:27.835749 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-2e689121-91de-488f-80ae-d073e9212106 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] HTTP exception thrown: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2e689121-91de-488f-80ae-d073e9212106 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Request method failure captured: Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332/os-volume_attachments HTTP/1.1 Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cj8VDPZhyQ6nFGU8uGM5i-Igq4NR3aZ2w67n2_4TPtShHDPY_VorsN9D3IWmBQgNfq2Ll8AZLP6fXWobWt7yMLeHiZHc0-jwjyrT5pTCVQiBoMmhgDsMlColoaU1bGji77Id-SdrorUlKAtPRNMtRMvtkd9TVodGkCIHr43LUxcO0 Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 53d5e604b12545a68da3655cb6b881c5 Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-DeleteServersTestJSON-653682344 Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:22:27.839720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:22:27.841127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53d5e604b12545a68da3655cb6b881c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53d5e604b12545a68da3655cb6b881c5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53d5e604b12545a68da3655cb6b881c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53d5e604b12545a68da3655cb6b881c5"}]}] Sep 13 03:22:27.841127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-DeleteServersTestJSON-653682344 Sep 13 03:22:27.841127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 53d5e604b12545a68da3655cb6b881c5 Sep 13 03:22:27.841127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-DeleteServersTestJSON-653682344 Sep 13 03:22:27.841127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-DeleteServersTestJSON-653682344-project Sep 13 03:22:27.841127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:22:27.841127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:22:27.841127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 616dd34b9fde4ed6b42ec22421ebb504 Sep 13 03:22:27.841127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-DeleteServersTestJSON-653682344-project Sep 13 03:22:27.841127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:22:27.841127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:27.841127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'server_id': 'c92a5fc3-da4f-47bf-ab5e-c9c275f38332'} Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:22:27.841808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:27.842970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:22:27.844143 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2e689121-91de-488f-80ae-d073e9212106 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Returning 404 to user: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:22:27.844143 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2e689121-91de-488f-80ae-d073e9212106 tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035257 Sep 13 03:22:27.844143 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 137/299] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:22:27 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 03:22:27.854375 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-679c1e8f-65fa-445a-a684-0782aba4dfde tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:27.855260 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-679c1e8f-65fa-445a-a684-0782aba4dfde tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:27.861225 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-679c1e8f-65fa-445a-a684-0782aba4dfde tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:27.861882 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-679c1e8f-65fa-445a-a684-0782aba4dfde tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:27.862327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-679c1e8f-65fa-445a-a684-0782aba4dfde tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:27.863040 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-679c1e8f-65fa-445a-a684-0782aba4dfde tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:27.863501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-679c1e8f-65fa-445a-a684-0782aba4dfde tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:27.863923 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-679c1e8f-65fa-445a-a684-0782aba4dfde tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:28.004962 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-679c1e8f-65fa-445a-a684-0782aba4dfde tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:28.012535 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-679c1e8f-65fa-445a-a684-0782aba4dfde tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.162158 Sep 13 03:22:28.013097 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 163/300] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:27 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:29.036364 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4911f5ea-0b5e-44a0-a2d6-359d98460448 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:29.036979 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-4911f5ea-0b5e-44a0-a2d6-359d98460448 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:29.043591 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4911f5ea-0b5e-44a0-a2d6-359d98460448 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:29.044333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4911f5ea-0b5e-44a0-a2d6-359d98460448 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:29.044761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4911f5ea-0b5e-44a0-a2d6-359d98460448 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:29.045452 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4911f5ea-0b5e-44a0-a2d6-359d98460448 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:29.045897 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4911f5ea-0b5e-44a0-a2d6-359d98460448 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:29.046315 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4911f5ea-0b5e-44a0-a2d6-359d98460448 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:29.050357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:29.059885 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-eef5fcf5-1425-4445-8319-42092918ca8e tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:29.060956 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-eef5fcf5-1425-4445-8319-42092918ca8e tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:29.068067 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eef5fcf5-1425-4445-8319-42092918ca8e tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:29.068853 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eef5fcf5-1425-4445-8319-42092918ca8e tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:29.069294 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eef5fcf5-1425-4445-8319-42092918ca8e tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:29.070022 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eef5fcf5-1425-4445-8319-42092918ca8e tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:29.070478 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eef5fcf5-1425-4445-8319-42092918ca8e tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:29.070933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eef5fcf5-1425-4445-8319-42092918ca8e tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:29.087034 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-eef5fcf5-1425-4445-8319-42092918ca8e tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] HTTP exception thrown: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-eef5fcf5-1425-4445-8319-42092918ca8e tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Request method failure captured: Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: DELETE /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 HTTP/1.1 Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cj8VDPZhyQ6nFGU8uGM5i-Igq4NR3aZ2w67n2_4TPtShHDPY_VorsN9D3IWmBQgNfq2Ll8AZLP6fXWobWt7yMLeHiZHc0-jwjyrT5pTCVQiBoMmhgDsMlColoaU1bGji77Id-SdrorUlKAtPRNMtRMvtkd9TVodGkCIHr43LUxcO0 Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 53d5e604b12545a68da3655cb6b881c5 Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-DeleteServersTestJSON-653682344 Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:22:29.088936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:22:29.090152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53d5e604b12545a68da3655cb6b881c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53d5e604b12545a68da3655cb6b881c5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53d5e604b12545a68da3655cb6b881c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53d5e604b12545a68da3655cb6b881c5"}]}] Sep 13 03:22:29.090152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-DeleteServersTestJSON-653682344 Sep 13 03:22:29.090152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 53d5e604b12545a68da3655cb6b881c5 Sep 13 03:22:29.090152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-DeleteServersTestJSON-653682344 Sep 13 03:22:29.090152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-DeleteServersTestJSON-653682344-project Sep 13 03:22:29.090152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:22:29.090152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:22:29.090152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 616dd34b9fde4ed6b42ec22421ebb504 Sep 13 03:22:29.090152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-DeleteServersTestJSON-653682344-project Sep 13 03:22:29.090152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:22:29.090152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:29.090152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'c92a5fc3-da4f-47bf-ab5e-c9c275f38332'} Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:22:29.094350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:29.095648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:29.096877 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-eef5fcf5-1425-4445-8319-42092918ca8e tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Returning 404 to user: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:22:29.096877 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-eef5fcf5-1425-4445-8319-42092918ca8e tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 404 len: 111 microversion: 2.1 time: 0.034251 Sep 13 03:22:29.096877 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 164/301] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:22:29 2022] DELETE /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 03:22:29.099809 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-add1f09b-b8c3-4a8d-94c4-86825762e6ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:29.100418 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-add1f09b-b8c3-4a8d-94c4-86825762e6ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] [instance: c92a5fc3-da4f-47bf-ab5e-c9c275f38332] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:29.106312 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-add1f09b-b8c3-4a8d-94c4-86825762e6ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:29.106863 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-add1f09b-b8c3-4a8d-94c4-86825762e6ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:29.107300 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-add1f09b-b8c3-4a8d-94c4-86825762e6ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:29.108018 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-add1f09b-b8c3-4a8d-94c4-86825762e6ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:29.108475 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-add1f09b-b8c3-4a8d-94c4-86825762e6ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:29.108929 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-add1f09b-b8c3-4a8d-94c4-86825762e6ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:29.127152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-add1f09b-b8c3-4a8d-94c4-86825762e6ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] HTTP exception thrown: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-add1f09b-b8c3-4a8d-94c4-86825762e6ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Request method failure captured: Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 HTTP/1.1 Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cj8VDPZhyQ6nFGU8uGM5i-Igq4NR3aZ2w67n2_4TPtShHDPY_VorsN9D3IWmBQgNfq2Ll8AZLP6fXWobWt7yMLeHiZHc0-jwjyrT5pTCVQiBoMmhgDsMlColoaU1bGji77Id-SdrorUlKAtPRNMtRMvtkd9TVodGkCIHr43LUxcO0 Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 53d5e604b12545a68da3655cb6b881c5 Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-DeleteServersTestJSON-653682344 Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:22:29.128669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:22:29.129910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53d5e604b12545a68da3655cb6b881c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53d5e604b12545a68da3655cb6b881c5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53d5e604b12545a68da3655cb6b881c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53d5e604b12545a68da3655cb6b881c5"}]}] Sep 13 03:22:29.129910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-DeleteServersTestJSON-653682344 Sep 13 03:22:29.129910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 53d5e604b12545a68da3655cb6b881c5 Sep 13 03:22:29.129910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-DeleteServersTestJSON-653682344 Sep 13 03:22:29.129910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-DeleteServersTestJSON-653682344-project Sep 13 03:22:29.129910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:22:29.129910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:22:29.129910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 616dd34b9fde4ed6b42ec22421ebb504 Sep 13 03:22:29.129910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-DeleteServersTestJSON-653682344-project Sep 13 03:22:29.129910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:22:29.129910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:29.129910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'c92a5fc3-da4f-47bf-ab5e-c9c275f38332'} Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:22:29.130562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. Sep 13 03:22:29.131729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:22:29.132689 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-add1f09b-b8c3-4a8d-94c4-86825762e6ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] Returning 404 to user: Instance c92a5fc3-da4f-47bf-ab5e-c9c275f38332 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:22:29.132689 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-add1f09b-b8c3-4a8d-94c4-86825762e6ff tempest-DeleteServersTestJSON-653682344 tempest-DeleteServersTestJSON-653682344-project] 10.222.0.18 "GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332" status: 404 len: 111 microversion: 2.1 time: 0.034502 Sep 13 03:22:29.132689 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 165/302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:29 2022] GET /compute/v2.1/servers/c92a5fc3-da4f-47bf-ab5e-c9c275f38332 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:22:29.198775 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4911f5ea-0b5e-44a0-a2d6-359d98460448 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:29.206397 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4911f5ea-0b5e-44a0-a2d6-359d98460448 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.175004 Sep 13 03:22:29.206990 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 138/303] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:29 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:30.229306 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-02c2db43-fe32-4a32-8880-b5088eedd015 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:30.229926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-02c2db43-fe32-4a32-8880-b5088eedd015 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:30.235925 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02c2db43-fe32-4a32-8880-b5088eedd015 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:30.236417 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02c2db43-fe32-4a32-8880-b5088eedd015 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:30.236852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02c2db43-fe32-4a32-8880-b5088eedd015 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:30.237542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02c2db43-fe32-4a32-8880-b5088eedd015 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:30.238000 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02c2db43-fe32-4a32-8880-b5088eedd015 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:30.238982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02c2db43-fe32-4a32-8880-b5088eedd015 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:30.443387 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-02c2db43-fe32-4a32-8880-b5088eedd015 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:30.459673 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-02c2db43-fe32-4a32-8880-b5088eedd015 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.234035 Sep 13 03:22:30.460540 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 166/304] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:30 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:31.484885 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-381a2f70-5430-4e3c-b466-15737dc0c016 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:31.485511 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-381a2f70-5430-4e3c-b466-15737dc0c016 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:31.491765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-381a2f70-5430-4e3c-b466-15737dc0c016 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:31.492258 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-381a2f70-5430-4e3c-b466-15737dc0c016 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:31.492697 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-381a2f70-5430-4e3c-b466-15737dc0c016 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:31.493406 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-381a2f70-5430-4e3c-b466-15737dc0c016 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:31.493849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-381a2f70-5430-4e3c-b466-15737dc0c016 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:31.494275 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-381a2f70-5430-4e3c-b466-15737dc0c016 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:31.627180 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-381a2f70-5430-4e3c-b466-15737dc0c016 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:31.635767 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-381a2f70-5430-4e3c-b466-15737dc0c016 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.155811 Sep 13 03:22:31.636592 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 139/305] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:31 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:32.663281 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-34df0e00-1194-41d7-b8c7-3589aaea9bfb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:32.663671 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-34df0e00-1194-41d7-b8c7-3589aaea9bfb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:32.670097 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34df0e00-1194-41d7-b8c7-3589aaea9bfb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:32.670718 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34df0e00-1194-41d7-b8c7-3589aaea9bfb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:32.671144 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34df0e00-1194-41d7-b8c7-3589aaea9bfb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:32.671876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34df0e00-1194-41d7-b8c7-3589aaea9bfb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:32.672332 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34df0e00-1194-41d7-b8c7-3589aaea9bfb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:32.672764 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34df0e00-1194-41d7-b8c7-3589aaea9bfb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:33.147036 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-34df0e00-1194-41d7-b8c7-3589aaea9bfb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:33.156697 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-34df0e00-1194-41d7-b8c7-3589aaea9bfb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.499208 Sep 13 03:22:33.157385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 167/306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:32 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:34.181267 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-aca2ffbb-a536-4971-89b4-53e8a60d565e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:34.181876 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-aca2ffbb-a536-4971-89b4-53e8a60d565e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:34.188278 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aca2ffbb-a536-4971-89b4-53e8a60d565e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:34.188767 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aca2ffbb-a536-4971-89b4-53e8a60d565e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:34.189540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aca2ffbb-a536-4971-89b4-53e8a60d565e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:34.190239 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aca2ffbb-a536-4971-89b4-53e8a60d565e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:34.190881 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aca2ffbb-a536-4971-89b4-53e8a60d565e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:34.192033 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aca2ffbb-a536-4971-89b4-53e8a60d565e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:34.400800 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-aca2ffbb-a536-4971-89b4-53e8a60d565e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:34.409053 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-aca2ffbb-a536-4971-89b4-53e8a60d565e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.231535 Sep 13 03:22:34.427339 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 140/307] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:34 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:35.432683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1f1f83f7-647d-4502-baa9-62472f033469 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:35.433533 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1f1f83f7-647d-4502-baa9-62472f033469 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:35.435589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=69 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:35.440837 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1f1f83f7-647d-4502-baa9-62472f033469 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:35.441379 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1f1f83f7-647d-4502-baa9-62472f033469 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:35.442309 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1f1f83f7-647d-4502-baa9-62472f033469 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:35.443035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1f1f83f7-647d-4502-baa9-62472f033469 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:35.443491 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1f1f83f7-647d-4502-baa9-62472f033469 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:35.443917 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1f1f83f7-647d-4502-baa9-62472f033469 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:35.588098 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1f1f83f7-647d-4502-baa9-62472f033469 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:35.595814 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1f1f83f7-647d-4502-baa9-62472f033469 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.167020 Sep 13 03:22:35.596375 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 168/308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:35 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:36.620554 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7c253986-796e-4bec-b728-080ba4d6cd0a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:36.621396 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7c253986-796e-4bec-b728-080ba4d6cd0a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:36.629589 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7c253986-796e-4bec-b728-080ba4d6cd0a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:36.630211 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7c253986-796e-4bec-b728-080ba4d6cd0a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:36.631072 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7c253986-796e-4bec-b728-080ba4d6cd0a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:36.631779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7c253986-796e-4bec-b728-080ba4d6cd0a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:36.632229 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7c253986-796e-4bec-b728-080ba4d6cd0a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:36.632648 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7c253986-796e-4bec-b728-080ba4d6cd0a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:36.785598 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7c253986-796e-4bec-b728-080ba4d6cd0a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:36.793720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7c253986-796e-4bec-b728-080ba4d6cd0a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.177668 Sep 13 03:22:36.794538 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 141/309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:36 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:37.817088 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e9af7131-af0f-4c6a-9d8a-6dfc3cdc10f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:37.817701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e9af7131-af0f-4c6a-9d8a-6dfc3cdc10f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:37.823827 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9af7131-af0f-4c6a-9d8a-6dfc3cdc10f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:37.824319 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9af7131-af0f-4c6a-9d8a-6dfc3cdc10f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:37.824761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9af7131-af0f-4c6a-9d8a-6dfc3cdc10f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:37.825461 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9af7131-af0f-4c6a-9d8a-6dfc3cdc10f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:37.825920 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9af7131-af0f-4c6a-9d8a-6dfc3cdc10f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:37.826345 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9af7131-af0f-4c6a-9d8a-6dfc3cdc10f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:37.961239 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e9af7131-af0f-4c6a-9d8a-6dfc3cdc10f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:37.969045 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e9af7131-af0f-4c6a-9d8a-6dfc3cdc10f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.155747 Sep 13 03:22:37.969606 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 169/310] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:37 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:38.992373 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1d25c61f-4b64-4c9e-b3de-3489fc120c5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:38.993085 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-1d25c61f-4b64-4c9e-b3de-3489fc120c5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:38.999385 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1d25c61f-4b64-4c9e-b3de-3489fc120c5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:38.999876 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1d25c61f-4b64-4c9e-b3de-3489fc120c5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:39.000308 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1d25c61f-4b64-4c9e-b3de-3489fc120c5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:39.001114 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1d25c61f-4b64-4c9e-b3de-3489fc120c5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:39.001566 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1d25c61f-4b64-4c9e-b3de-3489fc120c5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:39.001984 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1d25c61f-4b64-4c9e-b3de-3489fc120c5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:39.134238 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-1d25c61f-4b64-4c9e-b3de-3489fc120c5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:39.142230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1d25c61f-4b64-4c9e-b3de-3489fc120c5e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.153831 Sep 13 03:22:39.142824 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 142/311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:38 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:40.166621 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a0db17b5-151e-4d6b-9d62-f76d3924a438 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:40.167250 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a0db17b5-151e-4d6b-9d62-f76d3924a438 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:40.173580 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0db17b5-151e-4d6b-9d62-f76d3924a438 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:40.174098 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0db17b5-151e-4d6b-9d62-f76d3924a438 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:40.174537 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0db17b5-151e-4d6b-9d62-f76d3924a438 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:40.175252 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0db17b5-151e-4d6b-9d62-f76d3924a438 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:40.175704 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0db17b5-151e-4d6b-9d62-f76d3924a438 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:40.176124 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0db17b5-151e-4d6b-9d62-f76d3924a438 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:40.193578 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:40.305783 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a0db17b5-151e-4d6b-9d62-f76d3924a438 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:40.313912 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a0db17b5-151e-4d6b-9d62-f76d3924a438 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.151088 Sep 13 03:22:40.314475 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 170/312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:40 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:41.338024 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5ea0bea3-368c-48af-b735-672e9f28c85e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:41.338631 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5ea0bea3-368c-48af-b735-672e9f28c85e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:41.345033 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5ea0bea3-368c-48af-b735-672e9f28c85e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:41.345520 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5ea0bea3-368c-48af-b735-672e9f28c85e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:41.345956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5ea0bea3-368c-48af-b735-672e9f28c85e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:41.346671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5ea0bea3-368c-48af-b735-672e9f28c85e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:41.347128 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5ea0bea3-368c-48af-b735-672e9f28c85e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:41.347551 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5ea0bea3-368c-48af-b735-672e9f28c85e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:41.470556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5ea0bea3-368c-48af-b735-672e9f28c85e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:41.478477 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5ea0bea3-368c-48af-b735-672e9f28c85e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.144391 Sep 13 03:22:41.479064 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 143/313] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:41 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:42.501423 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-693e9379-f851-4b3a-b71f-e00a0d7dfd7a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:42.502143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-693e9379-f851-4b3a-b71f-e00a0d7dfd7a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:42.508326 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-693e9379-f851-4b3a-b71f-e00a0d7dfd7a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:42.508814 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-693e9379-f851-4b3a-b71f-e00a0d7dfd7a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:42.509252 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-693e9379-f851-4b3a-b71f-e00a0d7dfd7a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:42.509945 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-693e9379-f851-4b3a-b71f-e00a0d7dfd7a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:42.510402 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-693e9379-f851-4b3a-b71f-e00a0d7dfd7a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:42.510927 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-693e9379-f851-4b3a-b71f-e00a0d7dfd7a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:42.639274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-693e9379-f851-4b3a-b71f-e00a0d7dfd7a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:42.647321 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-693e9379-f851-4b3a-b71f-e00a0d7dfd7a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.149744 Sep 13 03:22:42.647878 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 171/314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:42 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:43.669372 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-767faf49-e19b-49b1-86d1-6eb841dabbb7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:43.670505 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-767faf49-e19b-49b1-86d1-6eb841dabbb7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:43.677581 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-767faf49-e19b-49b1-86d1-6eb841dabbb7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:43.678077 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-767faf49-e19b-49b1-86d1-6eb841dabbb7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:43.678516 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-767faf49-e19b-49b1-86d1-6eb841dabbb7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:43.679232 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-767faf49-e19b-49b1-86d1-6eb841dabbb7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:43.679701 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-767faf49-e19b-49b1-86d1-6eb841dabbb7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:43.680129 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-767faf49-e19b-49b1-86d1-6eb841dabbb7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:43.807589 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-767faf49-e19b-49b1-86d1-6eb841dabbb7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:43.815210 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-767faf49-e19b-49b1-86d1-6eb841dabbb7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.149876 Sep 13 03:22:43.815770 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 144/315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:43 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:44.837131 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f510d950-6499-48bf-aa39-b5e05e0b601e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:44.837745 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f510d950-6499-48bf-aa39-b5e05e0b601e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:44.843698 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f510d950-6499-48bf-aa39-b5e05e0b601e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:44.844182 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f510d950-6499-48bf-aa39-b5e05e0b601e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:44.844617 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f510d950-6499-48bf-aa39-b5e05e0b601e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:44.845307 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f510d950-6499-48bf-aa39-b5e05e0b601e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:44.845758 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f510d950-6499-48bf-aa39-b5e05e0b601e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:44.846181 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f510d950-6499-48bf-aa39-b5e05e0b601e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:44.970841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f510d950-6499-48bf-aa39-b5e05e0b601e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:44.979092 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f510d950-6499-48bf-aa39-b5e05e0b601e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.145764 Sep 13 03:22:44.979681 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 172/316] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:44 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:46.002152 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-434b2225-2d5d-4612-b849-964ecafbb5da tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:46.002796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-434b2225-2d5d-4612-b849-964ecafbb5da tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:46.009251 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-434b2225-2d5d-4612-b849-964ecafbb5da tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:46.009792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-434b2225-2d5d-4612-b849-964ecafbb5da tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:46.010229 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-434b2225-2d5d-4612-b849-964ecafbb5da tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:46.011036 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-434b2225-2d5d-4612-b849-964ecafbb5da tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:46.011535 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-434b2225-2d5d-4612-b849-964ecafbb5da tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:46.011958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-434b2225-2d5d-4612-b849-964ecafbb5da tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:46.141321 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-434b2225-2d5d-4612-b849-964ecafbb5da tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:46.149493 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-434b2225-2d5d-4612-b849-964ecafbb5da tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.151108 Sep 13 03:22:46.150056 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 145/317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:45 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:47.172347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7c642fdd-ac69-41b9-b58e-302a909922d1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:47.172960 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7c642fdd-ac69-41b9-b58e-302a909922d1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:47.179421 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7c642fdd-ac69-41b9-b58e-302a909922d1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:47.179903 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7c642fdd-ac69-41b9-b58e-302a909922d1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:47.180337 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7c642fdd-ac69-41b9-b58e-302a909922d1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:47.181022 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7c642fdd-ac69-41b9-b58e-302a909922d1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:47.181477 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7c642fdd-ac69-41b9-b58e-302a909922d1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:47.181900 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7c642fdd-ac69-41b9-b58e-302a909922d1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:47.309977 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7c642fdd-ac69-41b9-b58e-302a909922d1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:47.317579 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7c642fdd-ac69-41b9-b58e-302a909922d1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.149293 Sep 13 03:22:47.318145 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 173/318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:47 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:48.340159 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ef273044-2c89-4348-a1ee-1238a1abc928 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:48.340701 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ef273044-2c89-4348-a1ee-1238a1abc928 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:48.347422 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef273044-2c89-4348-a1ee-1238a1abc928 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:48.347913 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef273044-2c89-4348-a1ee-1238a1abc928 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:48.348351 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef273044-2c89-4348-a1ee-1238a1abc928 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:48.349039 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef273044-2c89-4348-a1ee-1238a1abc928 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:48.349495 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef273044-2c89-4348-a1ee-1238a1abc928 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:48.349946 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef273044-2c89-4348-a1ee-1238a1abc928 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:48.478248 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ef273044-2c89-4348-a1ee-1238a1abc928 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:48.485912 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ef273044-2c89-4348-a1ee-1238a1abc928 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.149670 Sep 13 03:22:48.486471 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 146/319] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:48 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:49.509143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d168e98a-8fee-4347-8b2d-07bb70770122 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:49.510352 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d168e98a-8fee-4347-8b2d-07bb70770122 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:49.515962 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d168e98a-8fee-4347-8b2d-07bb70770122 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:49.516447 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d168e98a-8fee-4347-8b2d-07bb70770122 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:49.516882 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d168e98a-8fee-4347-8b2d-07bb70770122 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:49.517566 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d168e98a-8fee-4347-8b2d-07bb70770122 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:49.518021 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d168e98a-8fee-4347-8b2d-07bb70770122 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:49.518440 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d168e98a-8fee-4347-8b2d-07bb70770122 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:49.646255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d168e98a-8fee-4347-8b2d-07bb70770122 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:49.653740 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d168e98a-8fee-4347-8b2d-07bb70770122 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.148509 Sep 13 03:22:49.654293 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 174/320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:49 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:50.676010 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0c44edf3-6a8f-49d6-9052-d7f3bc1b0479 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:50.676629 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0c44edf3-6a8f-49d6-9052-d7f3bc1b0479 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:50.682899 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c44edf3-6a8f-49d6-9052-d7f3bc1b0479 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:50.683518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c44edf3-6a8f-49d6-9052-d7f3bc1b0479 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:50.683786 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c44edf3-6a8f-49d6-9052-d7f3bc1b0479 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:50.684462 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c44edf3-6a8f-49d6-9052-d7f3bc1b0479 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:50.684907 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c44edf3-6a8f-49d6-9052-d7f3bc1b0479 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:50.685322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c44edf3-6a8f-49d6-9052-d7f3bc1b0479 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:50.947131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0c44edf3-6a8f-49d6-9052-d7f3bc1b0479 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:50.954602 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0c44edf3-6a8f-49d6-9052-d7f3bc1b0479 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.282405 Sep 13 03:22:50.955166 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 147/321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:50 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:51.977979 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d1c9c4da-eb4c-4215-9c9c-5d38d6404fa6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:51.978682 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d1c9c4da-eb4c-4215-9c9c-5d38d6404fa6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:51.985616 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1c9c4da-eb4c-4215-9c9c-5d38d6404fa6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:51.986113 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1c9c4da-eb4c-4215-9c9c-5d38d6404fa6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:51.986643 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1c9c4da-eb4c-4215-9c9c-5d38d6404fa6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:51.987510 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1c9c4da-eb4c-4215-9c9c-5d38d6404fa6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:51.987970 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1c9c4da-eb4c-4215-9c9c-5d38d6404fa6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:51.988391 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1c9c4da-eb4c-4215-9c9c-5d38d6404fa6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:52.123109 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d1c9c4da-eb4c-4215-9c9c-5d38d6404fa6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:52.130761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d1c9c4da-eb4c-4215-9c9c-5d38d6404fa6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.157325 Sep 13 03:22:52.131330 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 175/322] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:51 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:22:53.153477 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1fb906e7-6072-41d2-953a-10137bb3d833 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:53.154121 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-1fb906e7-6072-41d2-953a-10137bb3d833 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:53.160516 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1fb906e7-6072-41d2-953a-10137bb3d833 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:53.161005 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1fb906e7-6072-41d2-953a-10137bb3d833 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:53.161945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1fb906e7-6072-41d2-953a-10137bb3d833 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:53.162648 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1fb906e7-6072-41d2-953a-10137bb3d833 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:53.163110 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1fb906e7-6072-41d2-953a-10137bb3d833 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:53.163536 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1fb906e7-6072-41d2-953a-10137bb3d833 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:53.287684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-1fb906e7-6072-41d2-953a-10137bb3d833 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:53.295713 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1fb906e7-6072-41d2-953a-10137bb3d833 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.146056 Sep 13 03:22:53.296273 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 148/323] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:53 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:54.318394 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5124e3ab-c03f-4d7c-9f50-f685c87129c1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:54.318987 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5124e3ab-c03f-4d7c-9f50-f685c87129c1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:54.325435 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5124e3ab-c03f-4d7c-9f50-f685c87129c1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:54.325919 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5124e3ab-c03f-4d7c-9f50-f685c87129c1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:54.326350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5124e3ab-c03f-4d7c-9f50-f685c87129c1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:54.327066 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5124e3ab-c03f-4d7c-9f50-f685c87129c1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:54.327522 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5124e3ab-c03f-4d7c-9f50-f685c87129c1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:54.327961 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5124e3ab-c03f-4d7c-9f50-f685c87129c1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:54.457178 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5124e3ab-c03f-4d7c-9f50-f685c87129c1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:54.465212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5124e3ab-c03f-4d7c-9f50-f685c87129c1 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.150860 Sep 13 03:22:54.465769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 176/324] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:54 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:55.488147 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-028c47da-301f-402a-932a-89d5bf1c6c87 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:55.488840 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-028c47da-301f-402a-932a-89d5bf1c6c87 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:55.495921 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-028c47da-301f-402a-932a-89d5bf1c6c87 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:55.496400 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-028c47da-301f-402a-932a-89d5bf1c6c87 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:55.496831 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-028c47da-301f-402a-932a-89d5bf1c6c87 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:55.497507 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-028c47da-301f-402a-932a-89d5bf1c6c87 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:55.497967 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-028c47da-301f-402a-932a-89d5bf1c6c87 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:55.498369 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-028c47da-301f-402a-932a-89d5bf1c6c87 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:55.628814 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-028c47da-301f-402a-932a-89d5bf1c6c87 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:55.637827 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-028c47da-301f-402a-932a-89d5bf1c6c87 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.153400 Sep 13 03:22:55.638577 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 149/325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:55 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:56.661082 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2417f1b5-6a7d-4578-abcb-05a266fba87f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:56.661695 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2417f1b5-6a7d-4578-abcb-05a266fba87f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:56.667558 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2417f1b5-6a7d-4578-abcb-05a266fba87f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:56.668041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2417f1b5-6a7d-4578-abcb-05a266fba87f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:56.668475 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2417f1b5-6a7d-4578-abcb-05a266fba87f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:56.669428 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2417f1b5-6a7d-4578-abcb-05a266fba87f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:56.669879 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2417f1b5-6a7d-4578-abcb-05a266fba87f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:56.670302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2417f1b5-6a7d-4578-abcb-05a266fba87f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:56.795520 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2417f1b5-6a7d-4578-abcb-05a266fba87f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:56.803731 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2417f1b5-6a7d-4578-abcb-05a266fba87f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.146479 Sep 13 03:22:56.804368 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 177/326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:56 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:57.826730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d5bb6001-d0b4-413a-85ee-5c86682ffd3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:57.827285 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d5bb6001-d0b4-413a-85ee-5c86682ffd3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:57.829590 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=30 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:57.835549 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d5bb6001-d0b4-413a-85ee-5c86682ffd3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:57.836026 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d5bb6001-d0b4-413a-85ee-5c86682ffd3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:57.836460 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d5bb6001-d0b4-413a-85ee-5c86682ffd3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:57.837131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d5bb6001-d0b4-413a-85ee-5c86682ffd3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:57.837578 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d5bb6001-d0b4-413a-85ee-5c86682ffd3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:57.837992 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d5bb6001-d0b4-413a-85ee-5c86682ffd3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:57.962184 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d5bb6001-d0b4-413a-85ee-5c86682ffd3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:57.969690 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d5bb6001-d0b4-413a-85ee-5c86682ffd3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.146873 Sep 13 03:22:57.970239 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 150/327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:57 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:22:58.992106 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1ac65d10-df79-43f0-b964-74ec64886688 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:22:58.992723 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1ac65d10-df79-43f0-b964-74ec64886688 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:22:58.998643 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1ac65d10-df79-43f0-b964-74ec64886688 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:58.999106 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1ac65d10-df79-43f0-b964-74ec64886688 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:58.999543 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1ac65d10-df79-43f0-b964-74ec64886688 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:59.000259 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1ac65d10-df79-43f0-b964-74ec64886688 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:22:59.000730 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1ac65d10-df79-43f0-b964-74ec64886688 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:22:59.001156 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1ac65d10-df79-43f0-b964-74ec64886688 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:22:59.131891 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1ac65d10-df79-43f0-b964-74ec64886688 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:22:59.139716 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1ac65d10-df79-43f0-b964-74ec64886688 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.151535 Sep 13 03:22:59.140287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 178/328] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:22:58 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:00.162415 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-991e6c2d-f5b9-421f-9763-bac85798d3bf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:00.163046 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-991e6c2d-f5b9-421f-9763-bac85798d3bf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:00.169657 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-991e6c2d-f5b9-421f-9763-bac85798d3bf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:00.170136 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-991e6c2d-f5b9-421f-9763-bac85798d3bf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:00.170567 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-991e6c2d-f5b9-421f-9763-bac85798d3bf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:00.171274 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-991e6c2d-f5b9-421f-9763-bac85798d3bf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:00.171725 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-991e6c2d-f5b9-421f-9763-bac85798d3bf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:00.172141 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-991e6c2d-f5b9-421f-9763-bac85798d3bf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:00.174652 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=77 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:00.310849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-991e6c2d-f5b9-421f-9763-bac85798d3bf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:00.313308 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-991e6c2d-f5b9-421f-9763-bac85798d3bf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.155325 Sep 13 03:23:00.313862 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 151/329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:00 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:23:01.335652 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4b8cccc8-fb1f-4867-afea-8b753851e474 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:01.336274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4b8cccc8-fb1f-4867-afea-8b753851e474 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:01.342157 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b8cccc8-fb1f-4867-afea-8b753851e474 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:01.342538 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b8cccc8-fb1f-4867-afea-8b753851e474 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:01.343083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b8cccc8-fb1f-4867-afea-8b753851e474 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:01.343783 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b8cccc8-fb1f-4867-afea-8b753851e474 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:01.344244 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b8cccc8-fb1f-4867-afea-8b753851e474 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:01.344668 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b8cccc8-fb1f-4867-afea-8b753851e474 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:01.471620 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4b8cccc8-fb1f-4867-afea-8b753851e474 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:01.479580 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4b8cccc8-fb1f-4867-afea-8b753851e474 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.147700 Sep 13 03:23:01.480141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 179/330] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:01 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:02.502616 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b93f6a2c-f063-46bb-88de-76d4b41699ef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:02.503293 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b93f6a2c-f063-46bb-88de-76d4b41699ef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:02.509765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b93f6a2c-f063-46bb-88de-76d4b41699ef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:02.510246 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b93f6a2c-f063-46bb-88de-76d4b41699ef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:02.510705 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b93f6a2c-f063-46bb-88de-76d4b41699ef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:02.511388 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b93f6a2c-f063-46bb-88de-76d4b41699ef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:02.511842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b93f6a2c-f063-46bb-88de-76d4b41699ef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:02.512265 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b93f6a2c-f063-46bb-88de-76d4b41699ef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:02.637466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b93f6a2c-f063-46bb-88de-76d4b41699ef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:02.645083 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b93f6a2c-f063-46bb-88de-76d4b41699ef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.146387 Sep 13 03:23:02.645585 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 152/331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:02 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:03.667316 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-854df42b-2810-4e96-902c-4a2b83b371b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:03.667932 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-854df42b-2810-4e96-902c-4a2b83b371b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:03.674113 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-854df42b-2810-4e96-902c-4a2b83b371b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:03.674603 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-854df42b-2810-4e96-902c-4a2b83b371b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:03.675077 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-854df42b-2810-4e96-902c-4a2b83b371b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:03.675765 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-854df42b-2810-4e96-902c-4a2b83b371b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:03.676246 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-854df42b-2810-4e96-902c-4a2b83b371b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:03.676670 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-854df42b-2810-4e96-902c-4a2b83b371b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:03.804044 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-854df42b-2810-4e96-902c-4a2b83b371b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:03.811687 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-854df42b-2810-4e96-902c-4a2b83b371b6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.148204 Sep 13 03:23:03.812247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 180/332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:03 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:04.834447 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b6fa7573-b447-4a1e-b594-3f77a3abd5bd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:04.835015 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b6fa7573-b447-4a1e-b594-3f77a3abd5bd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:04.841390 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6fa7573-b447-4a1e-b594-3f77a3abd5bd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:04.841875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6fa7573-b447-4a1e-b594-3f77a3abd5bd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:04.842463 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6fa7573-b447-4a1e-b594-3f77a3abd5bd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:04.843186 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6fa7573-b447-4a1e-b594-3f77a3abd5bd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:04.843645 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6fa7573-b447-4a1e-b594-3f77a3abd5bd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:04.844067 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b6fa7573-b447-4a1e-b594-3f77a3abd5bd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:04.970212 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b6fa7573-b447-4a1e-b594-3f77a3abd5bd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:04.978355 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b6fa7573-b447-4a1e-b594-3f77a3abd5bd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.148370 Sep 13 03:23:04.978946 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 153/333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:04 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:06.001196 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9ee3805f-d22a-405e-99eb-3535d976137c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:06.002095 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9ee3805f-d22a-405e-99eb-3535d976137c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:06.005109 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=26 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:06.011691 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9ee3805f-d22a-405e-99eb-3535d976137c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:06.012359 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9ee3805f-d22a-405e-99eb-3535d976137c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:06.012875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9ee3805f-d22a-405e-99eb-3535d976137c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:06.014080 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9ee3805f-d22a-405e-99eb-3535d976137c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:06.014563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9ee3805f-d22a-405e-99eb-3535d976137c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:06.015125 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9ee3805f-d22a-405e-99eb-3535d976137c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:06.148967 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-378ebec2-4589-4299-81e7-befb074ea95a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0120cedf-9fc4-45a3-a999-4387f5a9b399", "device": "/dev/sdb"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:23:06.153241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-378ebec2-4589-4299-81e7-befb074ea95a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:06.184322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378ebec2-4589-4299-81e7-befb074ea95a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:06.185275 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378ebec2-4589-4299-81e7-befb074ea95a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:06.187025 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378ebec2-4589-4299-81e7-befb074ea95a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:06.188261 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378ebec2-4589-4299-81e7-befb074ea95a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:06.188916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378ebec2-4589-4299-81e7-befb074ea95a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:06.191625 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378ebec2-4589-4299-81e7-befb074ea95a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:06.203662 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9ee3805f-d22a-405e-99eb-3535d976137c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:06.218027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9ee3805f-d22a-405e-99eb-3535d976137c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.220831 Sep 13 03:23:06.218641 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 181/334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:05 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:06.800062 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-378ebec2-4589-4299-81e7-befb074ea95a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "POST /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.655291 Sep 13 03:23:06.800674 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 154/335] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:23:06 2022] POST /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:23:07.241799 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4f09d8ba-4e7d-45e9-b203-3624498d01dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:07.242476 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4f09d8ba-4e7d-45e9-b203-3624498d01dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:07.248454 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4f09d8ba-4e7d-45e9-b203-3624498d01dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:07.248946 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4f09d8ba-4e7d-45e9-b203-3624498d01dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:07.249385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4f09d8ba-4e7d-45e9-b203-3624498d01dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:07.250083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4f09d8ba-4e7d-45e9-b203-3624498d01dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:07.250535 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4f09d8ba-4e7d-45e9-b203-3624498d01dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:07.250985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4f09d8ba-4e7d-45e9-b203-3624498d01dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:07.395965 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4f09d8ba-4e7d-45e9-b203-3624498d01dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:07.405327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4f09d8ba-4e7d-45e9-b203-3624498d01dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.167971 Sep 13 03:23:07.405897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 182/336] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:07 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:08.431407 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ef857d88-6919-419b-be27-32343677ac70 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:08.433015 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ef857d88-6919-419b-be27-32343677ac70 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:08.439776 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef857d88-6919-419b-be27-32343677ac70 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:08.440292 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef857d88-6919-419b-be27-32343677ac70 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:08.440740 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef857d88-6919-419b-be27-32343677ac70 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:08.441433 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef857d88-6919-419b-be27-32343677ac70 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:08.441889 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef857d88-6919-419b-be27-32343677ac70 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:08.442306 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ef857d88-6919-419b-be27-32343677ac70 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:08.656337 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ef857d88-6919-419b-be27-32343677ac70 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:08.665943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ef857d88-6919-419b-be27-32343677ac70 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1523 microversion: 2.1 time: 0.240384 Sep 13 03:23:08.666791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 155/337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:08 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:09.689204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8703f755-d652-4466-8dee-084c49a150cf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:09.689957 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8703f755-d652-4466-8dee-084c49a150cf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:09.696451 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8703f755-d652-4466-8dee-084c49a150cf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:09.696936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8703f755-d652-4466-8dee-084c49a150cf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:09.697404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8703f755-d652-4466-8dee-084c49a150cf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:09.698093 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8703f755-d652-4466-8dee-084c49a150cf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:09.698547 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8703f755-d652-4466-8dee-084c49a150cf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:09.699007 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8703f755-d652-4466-8dee-084c49a150cf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:09.826274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-8703f755-d652-4466-8dee-084c49a150cf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:09.833841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8703f755-d652-4466-8dee-084c49a150cf tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1503 microversion: 2.1 time: 0.148510 Sep 13 03:23:09.835012 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 183/338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:09 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:09.855991 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-04a562e6-5897-4254-b164-4fccf8421eee tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:09.856605 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-04a562e6-5897-4254-b164-4fccf8421eee tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:09.862862 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04a562e6-5897-4254-b164-4fccf8421eee tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:09.863350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04a562e6-5897-4254-b164-4fccf8421eee tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:09.863787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04a562e6-5897-4254-b164-4fccf8421eee tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:09.864475 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04a562e6-5897-4254-b164-4fccf8421eee tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:09.864931 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04a562e6-5897-4254-b164-4fccf8421eee tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:09.865861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-04a562e6-5897-4254-b164-4fccf8421eee tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:09.997599 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-04a562e6-5897-4254-b164-4fccf8421eee tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:10.005814 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-04a562e6-5897-4254-b164-4fccf8421eee tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1517 microversion: 2.1 time: 0.153575 Sep 13 03:23:10.007213 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 156/339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:09 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:12.444492 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-fd521924-caa3-49d2-a167-c3d658d8ad28 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:23:12.446829 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-fd521924-caa3-49d2-a167-c3d658d8ad28 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:12.452630 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fd521924-caa3-49d2-a167-c3d658d8ad28 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:12.453116 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fd521924-caa3-49d2-a167-c3d658d8ad28 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:12.453551 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fd521924-caa3-49d2-a167-c3d658d8ad28 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:12.454242 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fd521924-caa3-49d2-a167-c3d658d8ad28 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:12.454719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fd521924-caa3-49d2-a167-c3d658d8ad28 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:12.455147 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fd521924-caa3-49d2-a167-c3d658d8ad28 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:12.458697 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=81 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:12.478643 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-fd521924-caa3-49d2-a167-c3d658d8ad28 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lazy-loading 'flavor' on Instance uuid 722dd938-0b13-46d0-9fa1-ff945702438c {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:23:12.553910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-fd521924-caa3-49d2-a167-c3d658d8ad28 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "POST /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c/action" status: 200 len: 32 microversion: 2.1 time: 0.113402 Sep 13 03:23:12.554678 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 184/340] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:23:12 2022] POST /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c/action => generated 32 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 03:23:12.564400 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-358f5068-58ef-4b9b-9e99-ba9800c9e8c8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:12.565172 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-358f5068-58ef-4b9b-9e99-ba9800c9e8c8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:12.572045 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-358f5068-58ef-4b9b-9e99-ba9800c9e8c8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:12.572694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-358f5068-58ef-4b9b-9e99-ba9800c9e8c8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:12.573335 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-358f5068-58ef-4b9b-9e99-ba9800c9e8c8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:12.574174 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-358f5068-58ef-4b9b-9e99-ba9800c9e8c8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:12.574644 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-358f5068-58ef-4b9b-9e99-ba9800c9e8c8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:12.575098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-358f5068-58ef-4b9b-9e99-ba9800c9e8c8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:12.801052 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-358f5068-58ef-4b9b-9e99-ba9800c9e8c8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:12.810394 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-358f5068-58ef-4b9b-9e99-ba9800c9e8c8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.249953 Sep 13 03:23:12.811228 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 157/341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:12 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:23:13.834420 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e4176636-555e-4328-b258-8a3404e9da13 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:13.835701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e4176636-555e-4328-b258-8a3404e9da13 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:13.843169 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e4176636-555e-4328-b258-8a3404e9da13 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:13.843658 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e4176636-555e-4328-b258-8a3404e9da13 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:13.844140 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e4176636-555e-4328-b258-8a3404e9da13 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:13.844920 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e4176636-555e-4328-b258-8a3404e9da13 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:13.845376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e4176636-555e-4328-b258-8a3404e9da13 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:13.845829 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e4176636-555e-4328-b258-8a3404e9da13 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:14.002716 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e4176636-555e-4328-b258-8a3404e9da13 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:14.011595 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e4176636-555e-4328-b258-8a3404e9da13 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.182009 Sep 13 03:23:14.012334 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 185/342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:13 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:15.036432 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e1953da7-72c4-4777-aef7-5a6127a74388 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:15.038698 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e1953da7-72c4-4777-aef7-5a6127a74388 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:15.050998 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1953da7-72c4-4777-aef7-5a6127a74388 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:15.052059 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1953da7-72c4-4777-aef7-5a6127a74388 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:15.053356 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1953da7-72c4-4777-aef7-5a6127a74388 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:15.054230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1953da7-72c4-4777-aef7-5a6127a74388 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:15.055004 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1953da7-72c4-4777-aef7-5a6127a74388 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:15.055576 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1953da7-72c4-4777-aef7-5a6127a74388 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:15.289335 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-e1953da7-72c4-4777-aef7-5a6127a74388 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:15.299295 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e1953da7-72c4-4777-aef7-5a6127a74388 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.268293 Sep 13 03:23:15.303650 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 158/343] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:15 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:16.325297 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-476ff0dd-a6e2-4b98-8714-30b89ebe47a0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:16.326032 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-476ff0dd-a6e2-4b98-8714-30b89ebe47a0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:16.336792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-476ff0dd-a6e2-4b98-8714-30b89ebe47a0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:16.337285 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-476ff0dd-a6e2-4b98-8714-30b89ebe47a0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:16.337724 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-476ff0dd-a6e2-4b98-8714-30b89ebe47a0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:16.338431 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-476ff0dd-a6e2-4b98-8714-30b89ebe47a0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:16.339271 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-476ff0dd-a6e2-4b98-8714-30b89ebe47a0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:16.342954 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-476ff0dd-a6e2-4b98-8714-30b89ebe47a0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:16.533732 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-476ff0dd-a6e2-4b98-8714-30b89ebe47a0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:16.544096 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-476ff0dd-a6e2-4b98-8714-30b89ebe47a0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.222837 Sep 13 03:23:16.545120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 186/344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:16 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:17.568987 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7bf42179-34de-47c0-bf3e-1fd3316b7d1a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:17.570493 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7bf42179-34de-47c0-bf3e-1fd3316b7d1a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:17.582051 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7bf42179-34de-47c0-bf3e-1fd3316b7d1a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:17.582848 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7bf42179-34de-47c0-bf3e-1fd3316b7d1a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:17.583484 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7bf42179-34de-47c0-bf3e-1fd3316b7d1a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:17.585060 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7bf42179-34de-47c0-bf3e-1fd3316b7d1a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:17.585694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7bf42179-34de-47c0-bf3e-1fd3316b7d1a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:17.586116 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7bf42179-34de-47c0-bf3e-1fd3316b7d1a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:17.859919 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7bf42179-34de-47c0-bf3e-1fd3316b7d1a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:17.872534 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7bf42179-34de-47c0-bf3e-1fd3316b7d1a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.307812 Sep 13 03:23:17.873311 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 159/345] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:17 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:18.897051 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-30228da4-22f1-4831-8ca0-3043ce2d26fd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:18.899574 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-30228da4-22f1-4831-8ca0-3043ce2d26fd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:18.906694 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-30228da4-22f1-4831-8ca0-3043ce2d26fd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:18.907357 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-30228da4-22f1-4831-8ca0-3043ce2d26fd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:18.907985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-30228da4-22f1-4831-8ca0-3043ce2d26fd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:18.908695 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-30228da4-22f1-4831-8ca0-3043ce2d26fd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:18.909154 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-30228da4-22f1-4831-8ca0-3043ce2d26fd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:18.909803 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-30228da4-22f1-4831-8ca0-3043ce2d26fd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:19.171010 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-30228da4-22f1-4831-8ca0-3043ce2d26fd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:19.185570 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-30228da4-22f1-4831-8ca0-3043ce2d26fd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.293475 Sep 13 03:23:19.186173 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 187/346] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:18 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:20.211057 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-22a9e7dc-9390-4a17-a55d-600c85bc0b5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:20.211825 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-22a9e7dc-9390-4a17-a55d-600c85bc0b5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:20.219192 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22a9e7dc-9390-4a17-a55d-600c85bc0b5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:20.220194 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22a9e7dc-9390-4a17-a55d-600c85bc0b5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:20.220759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22a9e7dc-9390-4a17-a55d-600c85bc0b5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:20.221565 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22a9e7dc-9390-4a17-a55d-600c85bc0b5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:20.222205 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22a9e7dc-9390-4a17-a55d-600c85bc0b5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:20.223342 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22a9e7dc-9390-4a17-a55d-600c85bc0b5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:20.389841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-22a9e7dc-9390-4a17-a55d-600c85bc0b5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:20.398960 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-22a9e7dc-9390-4a17-a55d-600c85bc0b5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.193815 Sep 13 03:23:20.399522 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 160/347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:20 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:21.423396 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7a4bfede-02aa-4b56-81a6-444d5310154d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:21.424873 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7a4bfede-02aa-4b56-81a6-444d5310154d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:21.433297 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a4bfede-02aa-4b56-81a6-444d5310154d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:21.434067 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a4bfede-02aa-4b56-81a6-444d5310154d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:21.435671 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a4bfede-02aa-4b56-81a6-444d5310154d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:21.436507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a4bfede-02aa-4b56-81a6-444d5310154d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:21.437011 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a4bfede-02aa-4b56-81a6-444d5310154d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:21.437821 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a4bfede-02aa-4b56-81a6-444d5310154d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:21.628358 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7a4bfede-02aa-4b56-81a6-444d5310154d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:21.639409 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7a4bfede-02aa-4b56-81a6-444d5310154d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.220625 Sep 13 03:23:21.656356 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 188/348] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:21 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:22.676368 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-cddf6f6e-f804-416e-a1e6-a44fd0526ea6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:22.676994 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-cddf6f6e-f804-416e-a1e6-a44fd0526ea6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:22.700932 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cddf6f6e-f804-416e-a1e6-a44fd0526ea6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:22.701442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cddf6f6e-f804-416e-a1e6-a44fd0526ea6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:22.702145 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cddf6f6e-f804-416e-a1e6-a44fd0526ea6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:22.702901 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cddf6f6e-f804-416e-a1e6-a44fd0526ea6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:22.703397 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cddf6f6e-f804-416e-a1e6-a44fd0526ea6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:22.703830 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cddf6f6e-f804-416e-a1e6-a44fd0526ea6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:23.029495 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-cddf6f6e-f804-416e-a1e6-a44fd0526ea6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:23.039036 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-cddf6f6e-f804-416e-a1e6-a44fd0526ea6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.377942 Sep 13 03:23:23.039649 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 161/349] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:22 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:23.810805 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e74ece24-a65f-4e70-b754-18cbc5de6a2f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Action: 'create', calling method: .version_select at 0x7f8935b1cc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1965801472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAB79gWNoVBpeUlGFdbzanTZs1D3UJmMaztoTUu4ZGPLRkgnzUlUsf+NyT2SwWUF/2bE4gXoOsUY4cBOlphFm+l27jQyL4Fhqn5XITS90bHGNkh8FTXs7d9O3t0739QxUg=="}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:23:23.828631 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-e74ece24-a65f-4e70-b754-18cbc5de6a2f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Getting quotas for project fb8fff2dfb49442492296d4c1701abb1. Resources: {'key_pairs'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:23:23.833513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-e74ece24-a65f-4e70-b754-18cbc5de6a2f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Getting quotas for user 7ad4d86f4c8f450986870292477c1182 and project fb8fff2dfb49442492296d4c1701abb1. Resources: {'key_pairs'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:23:23.871524 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e74ece24-a65f-4e70-b754-18cbc5de6a2f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.233987 Sep 13 03:23:23.872351 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 189/350] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 03:23:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:23:24.062429 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-211f4b0b-8ca9-4a6c-9df9-2800d898af53 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:24.063119 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-211f4b0b-8ca9-4a6c-9df9-2800d898af53 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:24.071127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-211f4b0b-8ca9-4a6c-9df9-2800d898af53 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:24.071630 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-211f4b0b-8ca9-4a6c-9df9-2800d898af53 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:24.073249 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-211f4b0b-8ca9-4a6c-9df9-2800d898af53 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:24.074671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-211f4b0b-8ca9-4a6c-9df9-2800d898af53 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:24.076556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-211f4b0b-8ca9-4a6c-9df9-2800d898af53 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:24.077014 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-211f4b0b-8ca9-4a6c-9df9-2800d898af53 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:24.271592 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-211f4b0b-8ca9-4a6c-9df9-2800d898af53 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:24.281203 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-211f4b0b-8ca9-4a6c-9df9-2800d898af53 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.223058 Sep 13 03:23:24.297211 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 162/351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:24 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:25.306745 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f54de830-3d1f-433b-a92c-4a07ac213658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:25.308013 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f54de830-3d1f-433b-a92c-4a07ac213658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:25.314099 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f54de830-3d1f-433b-a92c-4a07ac213658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:25.314599 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f54de830-3d1f-433b-a92c-4a07ac213658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:25.315107 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f54de830-3d1f-433b-a92c-4a07ac213658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:25.316166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f54de830-3d1f-433b-a92c-4a07ac213658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:25.316634 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f54de830-3d1f-433b-a92c-4a07ac213658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:25.317064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f54de830-3d1f-433b-a92c-4a07ac213658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:25.467274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f54de830-3d1f-433b-a92c-4a07ac213658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:25.476136 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f54de830-3d1f-433b-a92c-4a07ac213658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.174809 Sep 13 03:23:25.476706 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 190/352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:25 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:26.498809 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f694cae7-560b-4825-babb-1eb262e658c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:26.499418 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f694cae7-560b-4825-babb-1eb262e658c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:26.506233 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f694cae7-560b-4825-babb-1eb262e658c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:26.506737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f694cae7-560b-4825-babb-1eb262e658c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:26.507176 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f694cae7-560b-4825-babb-1eb262e658c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:26.507880 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f694cae7-560b-4825-babb-1eb262e658c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:26.508328 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f694cae7-560b-4825-babb-1eb262e658c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:26.508745 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f694cae7-560b-4825-babb-1eb262e658c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:26.654354 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f694cae7-560b-4825-babb-1eb262e658c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:26.662517 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f694cae7-560b-4825-babb-1eb262e658c9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.167518 Sep 13 03:23:26.663226 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 163/353] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:26 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:27.686563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-03a8ccf5-f31d-436f-b719-f67f460b8c35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:27.687303 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-03a8ccf5-f31d-436f-b719-f67f460b8c35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:27.694154 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-03a8ccf5-f31d-436f-b719-f67f460b8c35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:27.694751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-03a8ccf5-f31d-436f-b719-f67f460b8c35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:27.695257 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-03a8ccf5-f31d-436f-b719-f67f460b8c35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:27.696035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-03a8ccf5-f31d-436f-b719-f67f460b8c35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:27.696564 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-03a8ccf5-f31d-436f-b719-f67f460b8c35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:27.696990 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-03a8ccf5-f31d-436f-b719-f67f460b8c35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:27.827793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-03a8ccf5-f31d-436f-b719-f67f460b8c35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:27.836320 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-03a8ccf5-f31d-436f-b719-f67f460b8c35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.153639 Sep 13 03:23:27.841874 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 191/354] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:27 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:28.860149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-48c3a6a0-a324-4cdc-bb80-90af0a50b6de tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:28.860781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-48c3a6a0-a324-4cdc-bb80-90af0a50b6de tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:28.867229 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=28 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:28.870388 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48c3a6a0-a324-4cdc-bb80-90af0a50b6de tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:28.870991 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48c3a6a0-a324-4cdc-bb80-90af0a50b6de tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:28.871444 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48c3a6a0-a324-4cdc-bb80-90af0a50b6de tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:28.872168 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48c3a6a0-a324-4cdc-bb80-90af0a50b6de tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:28.872628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48c3a6a0-a324-4cdc-bb80-90af0a50b6de tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:28.873240 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48c3a6a0-a324-4cdc-bb80-90af0a50b6de tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:29.006820 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-48c3a6a0-a324-4cdc-bb80-90af0a50b6de tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:29.016018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-48c3a6a0-a324-4cdc-bb80-90af0a50b6de tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.160343 Sep 13 03:23:29.016634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 164/355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:28 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:23:30.040027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-36aed3b8-e6c4-4b22-883b-4e9b6d639609 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:30.040807 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-36aed3b8-e6c4-4b22-883b-4e9b6d639609 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:30.047014 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36aed3b8-e6c4-4b22-883b-4e9b6d639609 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:30.047499 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36aed3b8-e6c4-4b22-883b-4e9b6d639609 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:30.047927 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36aed3b8-e6c4-4b22-883b-4e9b6d639609 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:30.048604 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36aed3b8-e6c4-4b22-883b-4e9b6d639609 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:30.049052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36aed3b8-e6c4-4b22-883b-4e9b6d639609 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:30.049467 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36aed3b8-e6c4-4b22-883b-4e9b6d639609 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:30.178994 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-36aed3b8-e6c4-4b22-883b-4e9b6d639609 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:30.186779 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-36aed3b8-e6c4-4b22-883b-4e9b6d639609 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.151017 Sep 13 03:23:30.187340 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 192/356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:30 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:31.209339 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-48e721b7-9f6a-4948-981a-4cac08f7ecef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:31.209972 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-48e721b7-9f6a-4948-981a-4cac08f7ecef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:31.216436 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48e721b7-9f6a-4948-981a-4cac08f7ecef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:31.216919 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48e721b7-9f6a-4948-981a-4cac08f7ecef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:31.217355 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48e721b7-9f6a-4948-981a-4cac08f7ecef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:31.218041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48e721b7-9f6a-4948-981a-4cac08f7ecef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:31.218496 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48e721b7-9f6a-4948-981a-4cac08f7ecef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:31.218949 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48e721b7-9f6a-4948-981a-4cac08f7ecef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:31.222784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:31.347339 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-48e721b7-9f6a-4948-981a-4cac08f7ecef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:31.355370 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-48e721b7-9f6a-4948-981a-4cac08f7ecef tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.149876 Sep 13 03:23:31.355929 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 165/357] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:31 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:32.378737 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-aab3c6bc-038e-4c46-98dd-fa96b6c869e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:32.379300 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-aab3c6bc-038e-4c46-98dd-fa96b6c869e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:32.385189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-aab3c6bc-038e-4c46-98dd-fa96b6c869e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:32.385674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-aab3c6bc-038e-4c46-98dd-fa96b6c869e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:32.386107 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-aab3c6bc-038e-4c46-98dd-fa96b6c869e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:32.386834 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-aab3c6bc-038e-4c46-98dd-fa96b6c869e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:32.387282 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-aab3c6bc-038e-4c46-98dd-fa96b6c869e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:32.387707 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-aab3c6bc-038e-4c46-98dd-fa96b6c869e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:32.511762 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-aab3c6bc-038e-4c46-98dd-fa96b6c869e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:32.519330 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-aab3c6bc-038e-4c46-98dd-fa96b6c869e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.144543 Sep 13 03:23:32.519892 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 193/358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:32 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:33.543560 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-51881fc7-03a0-49e5-a8a6-9b7b87743c95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:33.544204 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-51881fc7-03a0-49e5-a8a6-9b7b87743c95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:33.550571 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-51881fc7-03a0-49e5-a8a6-9b7b87743c95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:33.551089 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-51881fc7-03a0-49e5-a8a6-9b7b87743c95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:33.551526 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-51881fc7-03a0-49e5-a8a6-9b7b87743c95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:33.552828 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-51881fc7-03a0-49e5-a8a6-9b7b87743c95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:33.553286 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-51881fc7-03a0-49e5-a8a6-9b7b87743c95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:33.554273 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-51881fc7-03a0-49e5-a8a6-9b7b87743c95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:33.693906 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-51881fc7-03a0-49e5-a8a6-9b7b87743c95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:33.701633 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-51881fc7-03a0-49e5-a8a6-9b7b87743c95 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.162247 Sep 13 03:23:33.702349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 166/359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:33 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:34.724198 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f36b5cce-b717-4f90-9258-7c2520c352f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:34.724945 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f36b5cce-b717-4f90-9258-7c2520c352f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:34.727066 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=4 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:34.732767 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f36b5cce-b717-4f90-9258-7c2520c352f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:34.733174 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f36b5cce-b717-4f90-9258-7c2520c352f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:34.733605 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f36b5cce-b717-4f90-9258-7c2520c352f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:34.734295 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f36b5cce-b717-4f90-9258-7c2520c352f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:34.734772 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f36b5cce-b717-4f90-9258-7c2520c352f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:34.735191 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f36b5cce-b717-4f90-9258-7c2520c352f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:34.869299 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f36b5cce-b717-4f90-9258-7c2520c352f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:34.876898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f36b5cce-b717-4f90-9258-7c2520c352f7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.156591 Sep 13 03:23:34.877465 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 194/360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:34 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:35.900570 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a01b09d3-7c0b-4799-ae12-e670c1b8e212 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:35.901205 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a01b09d3-7c0b-4799-ae12-e670c1b8e212 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:35.907879 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a01b09d3-7c0b-4799-ae12-e670c1b8e212 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:35.908378 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a01b09d3-7c0b-4799-ae12-e670c1b8e212 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:35.908810 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a01b09d3-7c0b-4799-ae12-e670c1b8e212 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:35.909514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a01b09d3-7c0b-4799-ae12-e670c1b8e212 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:35.909964 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a01b09d3-7c0b-4799-ae12-e670c1b8e212 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:35.910383 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a01b09d3-7c0b-4799-ae12-e670c1b8e212 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:36.044036 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a01b09d3-7c0b-4799-ae12-e670c1b8e212 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:36.052010 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a01b09d3-7c0b-4799-ae12-e670c1b8e212 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.155854 Sep 13 03:23:36.052576 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 167/361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:35 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:37.074923 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-105b933d-a240-4827-ae39-1b3cad2af422 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:37.075718 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-105b933d-a240-4827-ae39-1b3cad2af422 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:37.078496 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:37.082200 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-105b933d-a240-4827-ae39-1b3cad2af422 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:37.082728 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-105b933d-a240-4827-ae39-1b3cad2af422 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:37.083170 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-105b933d-a240-4827-ae39-1b3cad2af422 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:37.084073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-105b933d-a240-4827-ae39-1b3cad2af422 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:37.085078 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-105b933d-a240-4827-ae39-1b3cad2af422 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:37.085519 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-105b933d-a240-4827-ae39-1b3cad2af422 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:37.230413 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-105b933d-a240-4827-ae39-1b3cad2af422 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:37.238535 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-105b933d-a240-4827-ae39-1b3cad2af422 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.167531 Sep 13 03:23:37.239347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 195/362] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:37 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:23:38.263164 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b161bc63-a012-46d2-8f3e-8b979d4e48e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:38.263690 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b161bc63-a012-46d2-8f3e-8b979d4e48e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:38.270044 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b161bc63-a012-46d2-8f3e-8b979d4e48e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:38.270532 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b161bc63-a012-46d2-8f3e-8b979d4e48e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:38.271003 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b161bc63-a012-46d2-8f3e-8b979d4e48e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:38.271689 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b161bc63-a012-46d2-8f3e-8b979d4e48e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:38.272159 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b161bc63-a012-46d2-8f3e-8b979d4e48e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:38.272572 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b161bc63-a012-46d2-8f3e-8b979d4e48e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:38.403766 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b161bc63-a012-46d2-8f3e-8b979d4e48e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:38.411477 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b161bc63-a012-46d2-8f3e-8b979d4e48e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.152263 Sep 13 03:23:38.412051 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 168/363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:38 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:39.435720 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-06ed0408-ab31-4da6-aee8-35a1a363440a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:39.436446 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-06ed0408-ab31-4da6-aee8-35a1a363440a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:39.445259 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06ed0408-ab31-4da6-aee8-35a1a363440a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:39.445761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06ed0408-ab31-4da6-aee8-35a1a363440a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:39.446201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06ed0408-ab31-4da6-aee8-35a1a363440a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:39.446967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06ed0408-ab31-4da6-aee8-35a1a363440a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:39.447421 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06ed0408-ab31-4da6-aee8-35a1a363440a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:39.447845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06ed0408-ab31-4da6-aee8-35a1a363440a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:39.584005 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-06ed0408-ab31-4da6-aee8-35a1a363440a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:39.592272 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-06ed0408-ab31-4da6-aee8-35a1a363440a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.160464 Sep 13 03:23:39.593083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 196/364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:39 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:40.147271 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2cf0fd37-d26e-4499-8ffe-ac2069c2e691 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:40.148348 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2cf0fd37-d26e-4499-8ffe-ac2069c2e691 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:40.155013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2cf0fd37-d26e-4499-8ffe-ac2069c2e691 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:40.155497 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2cf0fd37-d26e-4499-8ffe-ac2069c2e691 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:40.155928 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2cf0fd37-d26e-4499-8ffe-ac2069c2e691 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:40.156616 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2cf0fd37-d26e-4499-8ffe-ac2069c2e691 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:40.157065 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2cf0fd37-d26e-4499-8ffe-ac2069c2e691 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:40.157495 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2cf0fd37-d26e-4499-8ffe-ac2069c2e691 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:40.287905 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-2cf0fd37-d26e-4499-8ffe-ac2069c2e691 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lazy-loading 'services' on Instance uuid 01c384f0-cb60-4c77-94da-1c9b8055f3fe {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:23:40.406120 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2cf0fd37-d26e-4499-8ffe-ac2069c2e691 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "DELETE /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe/os-volume_attachments/0120cedf-9fc4-45a3-a999-4387f5a9b399" status: 202 len: 0 microversion: 2.1 time: 0.262824 Sep 13 03:23:40.406886 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 169/365] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 03:23:40 2022] DELETE /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe/os-volume_attachments/0120cedf-9fc4-45a3-a999-4387f5a9b399 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:23:40.615703 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1fa99246-d951-4b38-b9a5-31214a7f3fae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:40.616273 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1fa99246-d951-4b38-b9a5-31214a7f3fae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:40.622161 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1fa99246-d951-4b38-b9a5-31214a7f3fae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:40.622786 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1fa99246-d951-4b38-b9a5-31214a7f3fae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:40.623225 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1fa99246-d951-4b38-b9a5-31214a7f3fae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:40.623919 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1fa99246-d951-4b38-b9a5-31214a7f3fae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:40.624377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1fa99246-d951-4b38-b9a5-31214a7f3fae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:40.624809 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1fa99246-d951-4b38-b9a5-31214a7f3fae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:40.769539 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1fa99246-d951-4b38-b9a5-31214a7f3fae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:40.781643 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1fa99246-d951-4b38-b9a5-31214a7f3fae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1503 microversion: 2.1 time: 0.169833 Sep 13 03:23:40.782891 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 197/366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:40 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:40.807074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-71683b0f-24eb-411e-be42-e20735959311 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee132496-ab9f-4257-94ed-9d64abf8190c"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:23:40.810049 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-71683b0f-24eb-411e-be42-e20735959311 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:40.817178 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-71683b0f-24eb-411e-be42-e20735959311 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:40.817707 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-71683b0f-24eb-411e-be42-e20735959311 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:40.818175 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-71683b0f-24eb-411e-be42-e20735959311 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:40.819074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-71683b0f-24eb-411e-be42-e20735959311 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:40.819519 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-71683b0f-24eb-411e-be42-e20735959311 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:40.819945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-71683b0f-24eb-411e-be42-e20735959311 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:40.846330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-71683b0f-24eb-411e-be42-e20735959311 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] HTTP exception thrown: Cannot 'attach_volume' instance 722dd938-0b13-46d0-9fa1-ff945702438c while it is in vm_state rescued Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-71683b0f-24eb-411e-be42-e20735959311 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Request method failure captured: Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: POST /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c/os-volume_attachments HTTP/1.1 Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 74 Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_ckfyr_FdMe7JDHHYQ02j3Yi-uV_C-rB4-EtATCIFXSBWLGGhu9M98PVZJquzMru2LcuccQVe7G9t8nFYxTH3gfXeSgkIQO_KMYHzhIs9bP_Y8CpAoG2B5UzUZ2HsrVN9VQy5PjeEaRinTvDlcb_cFRPIRwhk4q_eTKwpu_yzwcs8M Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 609f8dcac1034d09a04192f4238b2857 Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:23:40.848041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:23:40.849449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/609f8dcac1034d09a04192f4238b2857"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_609f8dcac1034d09a04192f4238b2857", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/609f8dcac1034d09a04192f4238b2857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/609f8dcac1034d09a04192f4238b2857"}]}] Sep 13 03:23:40.849449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:23:40.849449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 609f8dcac1034d09a04192f4238b2857 Sep 13 03:23:40.849449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:23:40.849449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-ServerRescueNegativeTestJSON-1628822356-project Sep 13 03:23:40.849449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:23:40.849449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:23:40.849449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: b85258f01e1f436585eb6b9a4f3813b8 Sep 13 03:23:40.849449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1628822356-project Sep 13 03:23:40.849449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Sep 13 03:23:40.849449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {"volumeAttachment": {"volumeId": "ee132496-ab9f-4257-94ed-9d64abf8190c"}} Sep 13 03:23:40.849449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Cannot 'attach_volume' instance 722dd938-0b13-46d0-9fa1-ff945702438c while it is in vm_state rescued Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'server_id': '722dd938-0b13-46d0-9fa1-ff945702438c', 'body': {'volumeAttachment': {'volumeId': 'ee132496-ab9f-4257-94ed-9d64abf8190c'}}} Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 722dd938-0b13-46d0-9fa1-ff945702438c in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:23:40.850391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 722dd938-0b13-46d0-9fa1-ff945702438c while it is in vm_state rescued Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:23:40.851654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:23:40.853291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:23:40.853291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:23:40.853291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 722dd938-0b13-46d0-9fa1-ff945702438c while it is in vm_state rescued Sep 13 03:23:40.853291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:23:40.853291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-71683b0f-24eb-411e-be42-e20735959311 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Returning 409 to user: Cannot 'attach_volume' instance 722dd938-0b13-46d0-9fa1-ff945702438c while it is in vm_state rescued {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:23:40.853291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-71683b0f-24eb-411e-be42-e20735959311 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "POST /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047979 Sep 13 03:23:40.853291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 170/367] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:23:40 2022] POST /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 03:23:40.860033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-db5139ec-43fb-4ca6-b816-cf104d7c652b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:23:40.860570 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-db5139ec-43fb-4ca6-b816-cf104d7c652b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:40.867327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-db5139ec-43fb-4ca6-b816-cf104d7c652b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:40.867889 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-db5139ec-43fb-4ca6-b816-cf104d7c652b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:40.868326 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-db5139ec-43fb-4ca6-b816-cf104d7c652b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:40.869049 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-db5139ec-43fb-4ca6-b816-cf104d7c652b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:40.869687 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-db5139ec-43fb-4ca6-b816-cf104d7c652b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:40.870162 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-db5139ec-43fb-4ca6-b816-cf104d7c652b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:40.928347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:40.938033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-db5139ec-43fb-4ca6-b816-cf104d7c652b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "POST /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c/action" status: 202 len: 0 microversion: 2.1 time: 0.082216 Sep 13 03:23:40.938683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 198/368] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:23:40 2022] POST /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:23:40.947250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b78470d7-8be7-4e71-8174-96ac0029dc76 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:40.947879 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b78470d7-8be7-4e71-8174-96ac0029dc76 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:40.953815 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b78470d7-8be7-4e71-8174-96ac0029dc76 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:40.954297 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b78470d7-8be7-4e71-8174-96ac0029dc76 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:40.954759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b78470d7-8be7-4e71-8174-96ac0029dc76 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:40.955434 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b78470d7-8be7-4e71-8174-96ac0029dc76 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:40.955883 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b78470d7-8be7-4e71-8174-96ac0029dc76 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:40.956298 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b78470d7-8be7-4e71-8174-96ac0029dc76 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:41.088892 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b78470d7-8be7-4e71-8174-96ac0029dc76 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:41.096575 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b78470d7-8be7-4e71-8174-96ac0029dc76 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1511 microversion: 2.1 time: 0.153683 Sep 13 03:23:41.097126 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 171/369] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:40 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:42.121123 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2a81b13c-119f-4e7b-93d1-3527c81ede55 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:42.121828 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2a81b13c-119f-4e7b-93d1-3527c81ede55 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:42.128205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a81b13c-119f-4e7b-93d1-3527c81ede55 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:42.128701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a81b13c-119f-4e7b-93d1-3527c81ede55 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:42.129145 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a81b13c-119f-4e7b-93d1-3527c81ede55 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:42.129834 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a81b13c-119f-4e7b-93d1-3527c81ede55 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:42.130307 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a81b13c-119f-4e7b-93d1-3527c81ede55 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:42.130764 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a81b13c-119f-4e7b-93d1-3527c81ede55 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:42.263120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2a81b13c-119f-4e7b-93d1-3527c81ede55 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:42.271037 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2a81b13c-119f-4e7b-93d1-3527c81ede55 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1511 microversion: 2.1 time: 0.154934 Sep 13 03:23:42.271613 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 199/370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:42 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:42.596318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-753a611c-df13-4d9a-83b2-d5e250be815e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:42.596881 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-753a611c-df13-4d9a-83b2-d5e250be815e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:42.603654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-753a611c-df13-4d9a-83b2-d5e250be815e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:42.604135 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-753a611c-df13-4d9a-83b2-d5e250be815e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:42.604566 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-753a611c-df13-4d9a-83b2-d5e250be815e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:42.605245 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-753a611c-df13-4d9a-83b2-d5e250be815e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:42.605694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-753a611c-df13-4d9a-83b2-d5e250be815e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:42.606252 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-753a611c-df13-4d9a-83b2-d5e250be815e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:42.632948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-753a611c-df13-4d9a-83b2-d5e250be815e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:23:42.707557 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-753a611c-df13-4d9a-83b2-d5e250be815e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "DELETE /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 204 len: 0 microversion: 2.1 time: 0.114900 Sep 13 03:23:42.708135 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 172/371] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:23:42 2022] DELETE /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:23:42.716109 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7857b872-549f-43b3-9aa0-4bcbd1996aac tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:42.716718 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7857b872-549f-43b3-9aa0-4bcbd1996aac tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:42.722710 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7857b872-549f-43b3-9aa0-4bcbd1996aac tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:42.723200 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7857b872-549f-43b3-9aa0-4bcbd1996aac tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:42.723658 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7857b872-549f-43b3-9aa0-4bcbd1996aac tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:42.724353 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7857b872-549f-43b3-9aa0-4bcbd1996aac tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:42.724805 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7857b872-549f-43b3-9aa0-4bcbd1996aac tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:42.725224 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7857b872-549f-43b3-9aa0-4bcbd1996aac tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:42.859558 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7857b872-549f-43b3-9aa0-4bcbd1996aac tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:42.867057 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7857b872-549f-43b3-9aa0-4bcbd1996aac tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1513 microversion: 2.1 time: 0.154685 Sep 13 03:23:42.867618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 200/372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:42 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:43.294924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-55a1acaa-724c-4b48-8162-2a8024150e84 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:43.295636 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-55a1acaa-724c-4b48-8162-2a8024150e84 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:43.301641 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-55a1acaa-724c-4b48-8162-2a8024150e84 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:43.302130 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-55a1acaa-724c-4b48-8162-2a8024150e84 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:43.302572 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-55a1acaa-724c-4b48-8162-2a8024150e84 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:43.303290 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-55a1acaa-724c-4b48-8162-2a8024150e84 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:43.303744 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-55a1acaa-724c-4b48-8162-2a8024150e84 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:43.304172 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-55a1acaa-724c-4b48-8162-2a8024150e84 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:43.439873 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-55a1acaa-724c-4b48-8162-2a8024150e84 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:43.450245 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-55a1acaa-724c-4b48-8162-2a8024150e84 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1511 microversion: 2.1 time: 0.159815 Sep 13 03:23:43.451071 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 173/373] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:43 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:43.889957 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2eaf9176-2244-4f6c-8481-c0369940d2e6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:43.890594 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2eaf9176-2244-4f6c-8481-c0369940d2e6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:43.897517 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2eaf9176-2244-4f6c-8481-c0369940d2e6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:43.897758 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2eaf9176-2244-4f6c-8481-c0369940d2e6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:43.898416 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2eaf9176-2244-4f6c-8481-c0369940d2e6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:43.899146 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2eaf9176-2244-4f6c-8481-c0369940d2e6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:43.899602 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2eaf9176-2244-4f6c-8481-c0369940d2e6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:43.900018 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2eaf9176-2244-4f6c-8481-c0369940d2e6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:44.087214 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2eaf9176-2244-4f6c-8481-c0369940d2e6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:44.095520 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2eaf9176-2244-4f6c-8481-c0369940d2e6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1513 microversion: 2.1 time: 0.209425 Sep 13 03:23:44.096091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 201/374] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:43 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:44.479389 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f4c2a2d1-cf6a-4b29-a981-0fbab6bd65e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:44.480826 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f4c2a2d1-cf6a-4b29-a981-0fbab6bd65e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:44.487934 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f4c2a2d1-cf6a-4b29-a981-0fbab6bd65e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:44.488492 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f4c2a2d1-cf6a-4b29-a981-0fbab6bd65e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:44.489010 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f4c2a2d1-cf6a-4b29-a981-0fbab6bd65e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:44.489765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f4c2a2d1-cf6a-4b29-a981-0fbab6bd65e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:44.490286 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f4c2a2d1-cf6a-4b29-a981-0fbab6bd65e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:44.490808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f4c2a2d1-cf6a-4b29-a981-0fbab6bd65e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:44.644535 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f4c2a2d1-cf6a-4b29-a981-0fbab6bd65e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:44.653163 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f4c2a2d1-cf6a-4b29-a981-0fbab6bd65e9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1511 microversion: 2.1 time: 0.178592 Sep 13 03:23:44.654322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 174/375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:44 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:45.119733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3a34a652-6404-485c-9426-0f564d8a5ee2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:45.120239 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3a34a652-6404-485c-9426-0f564d8a5ee2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:45.126252 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3a34a652-6404-485c-9426-0f564d8a5ee2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:45.126773 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3a34a652-6404-485c-9426-0f564d8a5ee2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:45.127231 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3a34a652-6404-485c-9426-0f564d8a5ee2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:45.127893 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3a34a652-6404-485c-9426-0f564d8a5ee2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:45.128354 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3a34a652-6404-485c-9426-0f564d8a5ee2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:45.128788 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3a34a652-6404-485c-9426-0f564d8a5ee2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:45.263354 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3a34a652-6404-485c-9426-0f564d8a5ee2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:45.271413 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3a34a652-6404-485c-9426-0f564d8a5ee2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1513 microversion: 2.1 time: 0.156081 Sep 13 03:23:45.271979 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 202/376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:45 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:45.680451 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ebe43b3c-de62-49cc-b722-da116fcb38f0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:45.681091 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ebe43b3c-de62-49cc-b722-da116fcb38f0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:45.687399 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ebe43b3c-de62-49cc-b722-da116fcb38f0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:45.687881 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ebe43b3c-de62-49cc-b722-da116fcb38f0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:45.688363 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ebe43b3c-de62-49cc-b722-da116fcb38f0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:45.689022 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ebe43b3c-de62-49cc-b722-da116fcb38f0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:45.689479 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ebe43b3c-de62-49cc-b722-da116fcb38f0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:45.689903 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ebe43b3c-de62-49cc-b722-da116fcb38f0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:45.818038 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ebe43b3c-de62-49cc-b722-da116fcb38f0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:45.825863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ebe43b3c-de62-49cc-b722-da116fcb38f0 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1511 microversion: 2.1 time: 0.149844 Sep 13 03:23:45.826402 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 175/377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:45 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:46.294542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-44b3fda4-3957-4310-8d29-5df8dc9e0e98 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:46.295131 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-44b3fda4-3957-4310-8d29-5df8dc9e0e98 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:46.300988 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-44b3fda4-3957-4310-8d29-5df8dc9e0e98 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:46.301464 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-44b3fda4-3957-4310-8d29-5df8dc9e0e98 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:46.301886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-44b3fda4-3957-4310-8d29-5df8dc9e0e98 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:46.302560 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-44b3fda4-3957-4310-8d29-5df8dc9e0e98 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:46.303029 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-44b3fda4-3957-4310-8d29-5df8dc9e0e98 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:46.303442 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-44b3fda4-3957-4310-8d29-5df8dc9e0e98 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:46.434064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-44b3fda4-3957-4310-8d29-5df8dc9e0e98 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:46.441643 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-44b3fda4-3957-4310-8d29-5df8dc9e0e98 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1513 microversion: 2.1 time: 0.151260 Sep 13 03:23:46.442217 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 203/378] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:46 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:46.849095 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4ccfe3b1-4476-41be-aad1-a6a230b931fb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:46.849660 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-4ccfe3b1-4476-41be-aad1-a6a230b931fb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:46.855954 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4ccfe3b1-4476-41be-aad1-a6a230b931fb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:46.856442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4ccfe3b1-4476-41be-aad1-a6a230b931fb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:46.856879 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4ccfe3b1-4476-41be-aad1-a6a230b931fb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:46.857567 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4ccfe3b1-4476-41be-aad1-a6a230b931fb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:46.858022 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4ccfe3b1-4476-41be-aad1-a6a230b931fb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:46.858450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4ccfe3b1-4476-41be-aad1-a6a230b931fb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:46.991037 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4ccfe3b1-4476-41be-aad1-a6a230b931fb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:46.999390 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4ccfe3b1-4476-41be-aad1-a6a230b931fb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1517 microversion: 2.1 time: 0.154232 Sep 13 03:23:46.999969 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 176/379] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:46 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:47.465316 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4bbed1e3-01d8-49cf-95d3-4bcd9ff52496 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:47.465927 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4bbed1e3-01d8-49cf-95d3-4bcd9ff52496 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:47.471756 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4bbed1e3-01d8-49cf-95d3-4bcd9ff52496 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:47.472238 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4bbed1e3-01d8-49cf-95d3-4bcd9ff52496 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:47.472665 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4bbed1e3-01d8-49cf-95d3-4bcd9ff52496 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:47.473344 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4bbed1e3-01d8-49cf-95d3-4bcd9ff52496 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:47.473793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4bbed1e3-01d8-49cf-95d3-4bcd9ff52496 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:47.474210 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4bbed1e3-01d8-49cf-95d3-4bcd9ff52496 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:47.607211 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4bbed1e3-01d8-49cf-95d3-4bcd9ff52496 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:47.615499 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4bbed1e3-01d8-49cf-95d3-4bcd9ff52496 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1513 microversion: 2.1 time: 0.154483 Sep 13 03:23:47.616124 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 204/380] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:47 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:48.118199 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-cc592ef1-d68e-4837-bcd3-1bb544b5b6b5 req-d9b99f9f-4a96-47e8-9153-fb4d86801515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c384f0-cb60-4c77-94da-1c9b8055f3fe", "name": "network-vif-deleted", "tag": "cd68b0ee-f68a-44d9-87ad-66638f02cae6"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:23:48.134668 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-cc592ef1-d68e-4837-bcd3-1bb544b5b6b5 req-d9b99f9f-4a96-47e8-9153-fb4d86801515 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:48.135158 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-cc592ef1-d68e-4837-bcd3-1bb544b5b6b5 req-d9b99f9f-4a96-47e8-9153-fb4d86801515 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:48.135642 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-cc592ef1-d68e-4837-bcd3-1bb544b5b6b5 req-d9b99f9f-4a96-47e8-9153-fb4d86801515 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:48.146809 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-cc592ef1-d68e-4837-bcd3-1bb544b5b6b5 req-d9b99f9f-4a96-47e8-9153-fb4d86801515 service nova] Creating event network-vif-deleted:cd68b0ee-f68a-44d9-87ad-66638f02cae6 for instance 01c384f0-cb60-4c77-94da-1c9b8055f3fe on hv-cinder-85707 Sep 13 03:23:48.151878 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-cc592ef1-d68e-4837-bcd3-1bb544b5b6b5 req-d9b99f9f-4a96-47e8-9153-fb4d86801515 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037770 Sep 13 03:23:48.152472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 177/381] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:23:48.639203 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:48.639740 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:48.645584 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:48.646066 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:48.646499 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:48.647220 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:48.647677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:48.648097 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:48.677749 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:48.678221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:48.678679 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:48.679122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lazy-loading 'fault' on Instance uuid 01c384f0-cb60-4c77-94da-1c9b8055f3fe {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:23:48.719065 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:48.727583 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e896b453-ae73-4cbd-960e-7ebf7133af4e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 200 len: 1308 microversion: 2.1 time: 0.092251 Sep 13 03:23:48.728749 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 205/382] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:48 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:49.415366 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ef173a70-b20e-4897-ac55-1d15e073ff91 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Action: 'create', calling method: .version_select at 0x7f8935a7fd30>, body: {"keypair": {"name": "tempest-keypair-1199906739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYF5xsuGjdrzRWb8QN864os+mgLuYxjvQn86pJblO3y7Q3ibhRLfTnVjhzSXlwzgKt4l/XjtFoh+Y7+oF4lF5ad1lA3J1aVw3c+78p949emoUm0JLkr3ibUVGB/Cpv3JA=="}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:23:49.431291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-ef173a70-b20e-4897-ac55-1d15e073ff91 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Getting quotas for project 609f8dcac1034d09a04192f4238b2857. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:23:49.435100 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-ef173a70-b20e-4897-ac55-1d15e073ff91 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Getting quotas for user b85258f01e1f436585eb6b9a4f3813b8 and project 609f8dcac1034d09a04192f4238b2857. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:23:49.456912 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ef173a70-b20e-4897-ac55-1d15e073ff91 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046729 Sep 13 03:23:49.457526 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 178/383] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 03:23:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:23:49.751369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9cc7e7de-74bf-4772-8558-410fdc779eb8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:49.752007 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9cc7e7de-74bf-4772-8558-410fdc779eb8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 01c384f0-cb60-4c77-94da-1c9b8055f3fe] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:49.758341 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9cc7e7de-74bf-4772-8558-410fdc779eb8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:49.759070 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9cc7e7de-74bf-4772-8558-410fdc779eb8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:49.759610 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9cc7e7de-74bf-4772-8558-410fdc779eb8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:49.760312 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9cc7e7de-74bf-4772-8558-410fdc779eb8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:49.760769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9cc7e7de-74bf-4772-8558-410fdc779eb8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:49.761190 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9cc7e7de-74bf-4772-8558-410fdc779eb8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:49.776702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-9cc7e7de-74bf-4772-8558-410fdc779eb8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] HTTP exception thrown: Instance 01c384f0-cb60-4c77-94da-1c9b8055f3fe could not be found. Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9cc7e7de-74bf-4772-8558-410fdc779eb8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Request method failure captured: Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe HTTP/1.1 Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_c4vCoAaeLkPSLhNibktjPn3EflmBX9BIaKuX5nuBmx4F-vsOZgZSxI3kzD-47SUevVPrDu1GgfcnY3x753y6G0w1UGAsOOE_7int_q0TI12QSGOAwOi93rPABiEH8scJfAdwrCVKdskJtKc9po6WqEZyUrlemSvnksgdE9PSEZBxU Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: b3ef3a6638114e1f9c838b00285f43f6 Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-VolumesSnapshotTestJSON-900372526 Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:23:49.778404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:23:49.779871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b3ef3a6638114e1f9c838b00285f43f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b3ef3a6638114e1f9c838b00285f43f6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3ef3a6638114e1f9c838b00285f43f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3ef3a6638114e1f9c838b00285f43f6"}]}] Sep 13 03:23:49.779871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-VolumesSnapshotTestJSON-900372526 Sep 13 03:23:49.779871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: b3ef3a6638114e1f9c838b00285f43f6 Sep 13 03:23:49.779871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-900372526 Sep 13 03:23:49.779871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-VolumesSnapshotTestJSON-900372526-project Sep 13 03:23:49.779871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:23:49.779871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:23:49.779871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 466f990dcac84f4faec701b28616273e Sep 13 03:23:49.779871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-VolumesSnapshotTestJSON-900372526-project Sep 13 03:23:49.779871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:23:49.779871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance 01c384f0-cb60-4c77-94da-1c9b8055f3fe could not be found. Sep 13 03:23:49.779871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': '01c384f0-cb60-4c77-94da-1c9b8055f3fe'} Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c384f0-cb60-4c77-94da-1c9b8055f3fe could not be found. Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:23:49.780856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c384f0-cb60-4c77-94da-1c9b8055f3fe could not be found. Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c384f0-cb60-4c77-94da-1c9b8055f3fe could not be found. Sep 13 03:23:49.782346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:23:49.783668 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9cc7e7de-74bf-4772-8558-410fdc779eb8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Returning 404 to user: Instance 01c384f0-cb60-4c77-94da-1c9b8055f3fe could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:23:49.783668 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9cc7e7de-74bf-4772-8558-410fdc779eb8 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe" status: 404 len: 111 microversion: 2.1 time: 0.032581 Sep 13 03:23:49.783668 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 206/384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:49 2022] GET /compute/v2.1/servers/01c384f0-cb60-4c77-94da-1c9b8055f3fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:23:50.777672 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2017690807", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb2e37f0-0a1e-4f79-8597-600d7213f51f"}], "security_groups": [{"name": "tempest-securitygroup--464777447"}], "key_name": "tempest-keypair-1199906739", "user_data": "}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:23:50.928589 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.network.neutron [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] validate_networks() for [('cb2e37f0-0a1e-4f79-8597-600d7213f51f', None, None, None, None, None)] {{(pid=120384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:23:51.578282 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Flavor limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:23:51.578943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Image limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:23:51.579432 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Flavor pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:23:51.579992 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Image pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:23:51.580483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:23:51.591105 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:51.591588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:51.592021 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:51.592747 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:51.593200 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:51.593622 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:51.610539 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Getting quotas for project 609f8dcac1034d09a04192f4238b2857. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:23:51.614708 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Getting quotas for user b85258f01e1f436585eb6b9a4f3813b8 and project 609f8dcac1034d09a04192f4238b2857. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:23:51.625828 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Going to run 1 instances... {{(pid=120384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:23:51.628288 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:23:51.676114 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-59df869b-193b-44f6-99fa-b81fe726833a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.903387 Sep 13 03:23:51.676774 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 179/385] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:23:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:23:51.687850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d40f43d0-b15f-408f-b40f-eb79567b7c69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:51.688457 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d40f43d0-b15f-408f-b40f-eb79567b7c69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:51.742903 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d40f43d0-b15f-408f-b40f-eb79567b7c69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:51.749787 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d40f43d0-b15f-408f-b40f-eb79567b7c69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1246 microversion: 2.1 time: 0.065784 Sep 13 03:23:51.750357 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 207/386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:51 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1246 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:52.773069 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c22584c2-6bb6-4806-9a03-16badfe63e35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:52.774552 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c22584c2-6bb6-4806-9a03-16badfe63e35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:52.780515 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c22584c2-6bb6-4806-9a03-16badfe63e35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:52.781083 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c22584c2-6bb6-4806-9a03-16badfe63e35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:52.781544 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c22584c2-6bb6-4806-9a03-16badfe63e35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:52.782336 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c22584c2-6bb6-4806-9a03-16badfe63e35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:52.782823 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c22584c2-6bb6-4806-9a03-16badfe63e35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:52.783246 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c22584c2-6bb6-4806-9a03-16badfe63e35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:52.844031 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c22584c2-6bb6-4806-9a03-16badfe63e35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:52.852267 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c22584c2-6bb6-4806-9a03-16badfe63e35 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1250 microversion: 2.1 time: 0.082873 Sep 13 03:23:52.852830 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 180/387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:52 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:53.874290 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6c3e94d5-0d30-498d-8af7-085f7461923e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:53.875009 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6c3e94d5-0d30-498d-8af7-085f7461923e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:53.880854 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6c3e94d5-0d30-498d-8af7-085f7461923e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:53.881351 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6c3e94d5-0d30-498d-8af7-085f7461923e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:53.881784 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6c3e94d5-0d30-498d-8af7-085f7461923e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:53.882524 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6c3e94d5-0d30-498d-8af7-085f7461923e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:53.883013 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6c3e94d5-0d30-498d-8af7-085f7461923e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:53.883436 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6c3e94d5-0d30-498d-8af7-085f7461923e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:53.948766 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6c3e94d5-0d30-498d-8af7-085f7461923e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:53.956632 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6c3e94d5-0d30-498d-8af7-085f7461923e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1250 microversion: 2.1 time: 0.086191 Sep 13 03:23:53.957193 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 208/388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:53 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:54.979276 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7eb49ddd-b690-4d46-a1f3-ced034976f01 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:54.979873 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7eb49ddd-b690-4d46-a1f3-ced034976f01 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:54.986165 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7eb49ddd-b690-4d46-a1f3-ced034976f01 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:54.986671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7eb49ddd-b690-4d46-a1f3-ced034976f01 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:54.987210 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7eb49ddd-b690-4d46-a1f3-ced034976f01 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:54.988022 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7eb49ddd-b690-4d46-a1f3-ced034976f01 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:54.988477 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7eb49ddd-b690-4d46-a1f3-ced034976f01 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:54.988983 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7eb49ddd-b690-4d46-a1f3-ced034976f01 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:55.050046 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7eb49ddd-b690-4d46-a1f3-ced034976f01 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:55.063028 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7eb49ddd-b690-4d46-a1f3-ced034976f01 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1250 microversion: 2.1 time: 0.087453 Sep 13 03:23:55.063934 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 181/389] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:54 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:56.085502 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6025b528-a9b9-4534-8e8e-b9567b16519b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:56.086173 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6025b528-a9b9-4534-8e8e-b9567b16519b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:56.092860 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6025b528-a9b9-4534-8e8e-b9567b16519b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:56.093348 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6025b528-a9b9-4534-8e8e-b9567b16519b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:56.093780 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6025b528-a9b9-4534-8e8e-b9567b16519b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:56.094470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6025b528-a9b9-4534-8e8e-b9567b16519b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:56.094964 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6025b528-a9b9-4534-8e8e-b9567b16519b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:56.095372 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6025b528-a9b9-4534-8e8e-b9567b16519b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:56.158874 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6025b528-a9b9-4534-8e8e-b9567b16519b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:56.166845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6025b528-a9b9-4534-8e8e-b9567b16519b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1250 microversion: 2.1 time: 0.085130 Sep 13 03:23:56.167479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 209/390] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:56 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:57.189400 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4937f9c3-b140-4fa0-8de9-6717b228158f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:57.190016 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-4937f9c3-b140-4fa0-8de9-6717b228158f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:57.197569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4937f9c3-b140-4fa0-8de9-6717b228158f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:57.198067 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4937f9c3-b140-4fa0-8de9-6717b228158f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:57.198534 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4937f9c3-b140-4fa0-8de9-6717b228158f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:57.199262 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4937f9c3-b140-4fa0-8de9-6717b228158f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:57.199719 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4937f9c3-b140-4fa0-8de9-6717b228158f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:57.200142 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4937f9c3-b140-4fa0-8de9-6717b228158f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:57.204594 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:57.274212 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4937f9c3-b140-4fa0-8de9-6717b228158f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:57.281924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4937f9c3-b140-4fa0-8de9-6717b228158f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1250 microversion: 2.1 time: 0.096456 Sep 13 03:23:57.282497 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 182/391] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:57 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1250 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:58.306325 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-56685b4a-2479-49b2-a4f2-6a7b87f98ef2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:58.306325 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-56685b4a-2479-49b2-a4f2-6a7b87f98ef2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:58.312438 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56685b4a-2479-49b2-a4f2-6a7b87f98ef2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:58.312975 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56685b4a-2479-49b2-a4f2-6a7b87f98ef2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:58.313597 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56685b4a-2479-49b2-a4f2-6a7b87f98ef2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:58.314307 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56685b4a-2479-49b2-a4f2-6a7b87f98ef2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:58.314803 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56685b4a-2479-49b2-a4f2-6a7b87f98ef2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:58.315238 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56685b4a-2479-49b2-a4f2-6a7b87f98ef2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:58.383707 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-56685b4a-2479-49b2-a4f2-6a7b87f98ef2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:58.391968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-56685b4a-2479-49b2-a4f2-6a7b87f98ef2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1250 microversion: 2.1 time: 0.091026 Sep 13 03:23:58.392544 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 210/392] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:58 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1250 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:23:59.414878 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-77feda28-22b1-4056-89d7-312cdbcbb8ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:23:59.415489 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-77feda28-22b1-4056-89d7-312cdbcbb8ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:23:59.417743 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:59.422848 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-77feda28-22b1-4056-89d7-312cdbcbb8ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:59.423354 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-77feda28-22b1-4056-89d7-312cdbcbb8ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:59.423775 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-77feda28-22b1-4056-89d7-312cdbcbb8ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:59.424463 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-77feda28-22b1-4056-89d7-312cdbcbb8ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:23:59.424914 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-77feda28-22b1-4056-89d7-312cdbcbb8ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:23:59.425332 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-77feda28-22b1-4056-89d7-312cdbcbb8ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:23:59.488382 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-77feda28-22b1-4056-89d7-312cdbcbb8ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:23:59.495915 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-77feda28-22b1-4056-89d7-312cdbcbb8ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1250 microversion: 2.1 time: 0.085520 Sep 13 03:23:59.496478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 183/393] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:23:59 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:00.517779 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d1aef724-6edb-46a9-a3e8-89309fd3b586 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:00.518511 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d1aef724-6edb-46a9-a3e8-89309fd3b586 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:00.524987 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1aef724-6edb-46a9-a3e8-89309fd3b586 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:00.525560 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1aef724-6edb-46a9-a3e8-89309fd3b586 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:00.526070 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1aef724-6edb-46a9-a3e8-89309fd3b586 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:00.526961 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1aef724-6edb-46a9-a3e8-89309fd3b586 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:00.527706 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1aef724-6edb-46a9-a3e8-89309fd3b586 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:00.527828 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1aef724-6edb-46a9-a3e8-89309fd3b586 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:00.589441 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d1aef724-6edb-46a9-a3e8-89309fd3b586 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:00.597019 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d1aef724-6edb-46a9-a3e8-89309fd3b586 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1298 microversion: 2.1 time: 0.083061 Sep 13 03:24:00.597592 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 211/394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:00 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:01.621171 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7d04fd99-b2cd-498a-a3f3-e4b0d6568a08 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:01.621776 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7d04fd99-b2cd-498a-a3f3-e4b0d6568a08 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:01.629750 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:01.630450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=10 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:01.633163 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7d04fd99-b2cd-498a-a3f3-e4b0d6568a08 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:01.633926 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7d04fd99-b2cd-498a-a3f3-e4b0d6568a08 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:01.634540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7d04fd99-b2cd-498a-a3f3-e4b0d6568a08 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:01.635787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7d04fd99-b2cd-498a-a3f3-e4b0d6568a08 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:01.636523 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7d04fd99-b2cd-498a-a3f3-e4b0d6568a08 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:01.637233 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7d04fd99-b2cd-498a-a3f3-e4b0d6568a08 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:01.735102 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7d04fd99-b2cd-498a-a3f3-e4b0d6568a08 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:01.755368 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7d04fd99-b2cd-498a-a3f3-e4b0d6568a08 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1304 microversion: 2.1 time: 0.138433 Sep 13 03:24:01.755955 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 184/395] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:01 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:02.634220 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-659fd1c6-fdb7-4df3-8505-e598caeaece8 req-f31ef8fa-6206-4ac4-b2d6-9356acc70e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f", "tag": "7cf9530c-a7c2-4a93-8567-f2298a93d7de"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:24:02.639917 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:02.645981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-659fd1c6-fdb7-4df3-8505-e598caeaece8 req-f31ef8fa-6206-4ac4-b2d6-9356acc70e7e service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:02.646503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-659fd1c6-fdb7-4df3-8505-e598caeaece8 req-f31ef8fa-6206-4ac4-b2d6-9356acc70e7e service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:02.646963 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-659fd1c6-fdb7-4df3-8505-e598caeaece8 req-f31ef8fa-6206-4ac4-b2d6-9356acc70e7e service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:02.658704 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-659fd1c6-fdb7-4df3-8505-e598caeaece8 req-f31ef8fa-6206-4ac4-b2d6-9356acc70e7e service nova] Creating event network-changed:7cf9530c-a7c2-4a93-8567-f2298a93d7de for instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f on hv-cinder-85707 Sep 13 03:24:02.664241 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-659fd1c6-fdb7-4df3-8505-e598caeaece8 req-f31ef8fa-6206-4ac4-b2d6-9356acc70e7e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033644 Sep 13 03:24:02.664830 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 212/396] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:24:02.780826 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5a1ed739-998c-4155-bc67-5d8481be9777 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:02.782236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5a1ed739-998c-4155-bc67-5d8481be9777 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:02.790161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a1ed739-998c-4155-bc67-5d8481be9777 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:02.790947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a1ed739-998c-4155-bc67-5d8481be9777 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:02.791678 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a1ed739-998c-4155-bc67-5d8481be9777 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:02.792818 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a1ed739-998c-4155-bc67-5d8481be9777 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:02.793725 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a1ed739-998c-4155-bc67-5d8481be9777 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:02.794343 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a1ed739-998c-4155-bc67-5d8481be9777 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:02.982791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5a1ed739-998c-4155-bc67-5d8481be9777 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:02.990778 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5a1ed739-998c-4155-bc67-5d8481be9777 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.214202 Sep 13 03:24:02.991366 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 185/397] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:02 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:04.014355 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c7638629-2e7e-4f5e-8112-c016bd1646d3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:04.015079 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c7638629-2e7e-4f5e-8112-c016bd1646d3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:04.022238 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c7638629-2e7e-4f5e-8112-c016bd1646d3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:04.022760 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c7638629-2e7e-4f5e-8112-c016bd1646d3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:04.023703 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c7638629-2e7e-4f5e-8112-c016bd1646d3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:04.024401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c7638629-2e7e-4f5e-8112-c016bd1646d3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:04.024855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c7638629-2e7e-4f5e-8112-c016bd1646d3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:04.025276 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c7638629-2e7e-4f5e-8112-c016bd1646d3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:04.160733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c7638629-2e7e-4f5e-8112-c016bd1646d3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:04.169812 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c7638629-2e7e-4f5e-8112-c016bd1646d3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.159724 Sep 13 03:24:04.170386 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 213/398] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:04 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:05.192453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5dcfbff7-e225-44e3-adc6-7a911986e3e8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:05.193063 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5dcfbff7-e225-44e3-adc6-7a911986e3e8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:05.199519 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5dcfbff7-e225-44e3-adc6-7a911986e3e8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:05.200010 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5dcfbff7-e225-44e3-adc6-7a911986e3e8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:05.200449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5dcfbff7-e225-44e3-adc6-7a911986e3e8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:05.201142 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5dcfbff7-e225-44e3-adc6-7a911986e3e8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:05.201598 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5dcfbff7-e225-44e3-adc6-7a911986e3e8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:05.202020 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5dcfbff7-e225-44e3-adc6-7a911986e3e8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:05.337037 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5dcfbff7-e225-44e3-adc6-7a911986e3e8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:05.344688 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5dcfbff7-e225-44e3-adc6-7a911986e3e8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.156184 Sep 13 03:24:05.345251 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 186/399] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:05 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:06.368127 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b13135b1-691c-4d14-92a6-a959bafb81d7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:06.368797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b13135b1-691c-4d14-92a6-a959bafb81d7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:06.375088 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b13135b1-691c-4d14-92a6-a959bafb81d7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:06.375576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b13135b1-691c-4d14-92a6-a959bafb81d7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:06.376003 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b13135b1-691c-4d14-92a6-a959bafb81d7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:06.376693 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b13135b1-691c-4d14-92a6-a959bafb81d7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:06.377142 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b13135b1-691c-4d14-92a6-a959bafb81d7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:06.377559 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b13135b1-691c-4d14-92a6-a959bafb81d7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:06.505574 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b13135b1-691c-4d14-92a6-a959bafb81d7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:06.513279 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b13135b1-691c-4d14-92a6-a959bafb81d7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.149703 Sep 13 03:24:06.513849 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 214/400] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:06 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:07.536258 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-97f79615-aa0c-4bfe-a67e-ac2563c67849 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:07.536847 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-97f79615-aa0c-4bfe-a67e-ac2563c67849 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:07.544088 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-97f79615-aa0c-4bfe-a67e-ac2563c67849 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:07.544569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-97f79615-aa0c-4bfe-a67e-ac2563c67849 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:07.545001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-97f79615-aa0c-4bfe-a67e-ac2563c67849 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:07.545686 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-97f79615-aa0c-4bfe-a67e-ac2563c67849 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:07.546137 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-97f79615-aa0c-4bfe-a67e-ac2563c67849 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:07.546553 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-97f79615-aa0c-4bfe-a67e-ac2563c67849 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:07.677089 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-97f79615-aa0c-4bfe-a67e-ac2563c67849 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:07.684789 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-97f79615-aa0c-4bfe-a67e-ac2563c67849 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.152421 Sep 13 03:24:07.685347 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 187/401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:07 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:08.707361 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a0021601-93be-49c0-93e6-bc516b45b121 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:08.707983 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a0021601-93be-49c0-93e6-bc516b45b121 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:08.710036 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=44 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:08.716322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0021601-93be-49c0-93e6-bc516b45b121 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:08.717108 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0021601-93be-49c0-93e6-bc516b45b121 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:08.717594 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0021601-93be-49c0-93e6-bc516b45b121 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:08.718391 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0021601-93be-49c0-93e6-bc516b45b121 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:08.718893 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0021601-93be-49c0-93e6-bc516b45b121 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:08.719444 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0021601-93be-49c0-93e6-bc516b45b121 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:08.877562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a0021601-93be-49c0-93e6-bc516b45b121 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:08.899731 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a0021601-93be-49c0-93e6-bc516b45b121 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.196034 Sep 13 03:24:08.900365 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 215/402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:08 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:09.083840 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1180982853", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "networks": [{"uuid": "9ed4d27b-3970-4114-ae33-5728b45fb5fc"}]}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:24:09.140755 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.network.neutron [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] validate_networks() for [('9ed4d27b-3970-4114-ae33-5728b45fb5fc', None, None, None, None, None)] {{(pid=120384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:24:09.483089 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Flavor limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:24:09.483447 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Image limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:24:09.483922 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Flavor pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:24:09.484326 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Image pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:24:09.484768 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:24:09.493867 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:09.494347 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:09.494823 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:09.495548 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:09.496005 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:09.496425 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:09.512681 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Getting quotas for project b3ef3a6638114e1f9c838b00285f43f6. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:24:09.516415 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Getting quotas for user 466f990dcac84f4faec701b28616273e and project b3ef3a6638114e1f9c838b00285f43f6. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:24:09.527078 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Going to run 1 instances... {{(pid=120384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:24:09.529224 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:24:09.575579 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5276fa4f-aa5b-4773-97da-a44e82a719b6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495591 Sep 13 03:24:09.576236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 188/403] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:24:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:24:09.587654 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a9a8c6e9-2a28-4535-8545-9eea53c144c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:09.588275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a9a8c6e9-2a28-4535-8545-9eea53c144c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:09.640153 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a9a8c6e9-2a28-4535-8545-9eea53c144c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:09.647026 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a9a8c6e9-2a28-4535-8545-9eea53c144c9 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1219 microversion: 2.1 time: 0.063546 Sep 13 03:24:09.647598 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 216/404] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:09 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:09.921484 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e38be0bd-0e81-47c1-913e-ae7e1866b1aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:09.922096 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e38be0bd-0e81-47c1-913e-ae7e1866b1aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:09.928224 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e38be0bd-0e81-47c1-913e-ae7e1866b1aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:09.928714 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e38be0bd-0e81-47c1-913e-ae7e1866b1aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:09.929163 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e38be0bd-0e81-47c1-913e-ae7e1866b1aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:09.929906 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e38be0bd-0e81-47c1-913e-ae7e1866b1aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:09.930365 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e38be0bd-0e81-47c1-913e-ae7e1866b1aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:09.930820 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e38be0bd-0e81-47c1-913e-ae7e1866b1aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:10.062639 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-e38be0bd-0e81-47c1-913e-ae7e1866b1aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:10.069765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e38be0bd-0e81-47c1-913e-ae7e1866b1aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.151834 Sep 13 03:24:10.070328 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 189/405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:09 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:10.669505 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f24df2e3-75fa-49f0-b124-6ded4547a0ca tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:10.670126 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f24df2e3-75fa-49f0-b124-6ded4547a0ca tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:10.724959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f24df2e3-75fa-49f0-b124-6ded4547a0ca tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:10.732764 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f24df2e3-75fa-49f0-b124-6ded4547a0ca tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1219 microversion: 2.1 time: 0.067249 Sep 13 03:24:10.733326 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 217/406] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:10 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:11.092134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-fad05654-bc66-455a-9fdf-66aa5529b28e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:11.092751 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-fad05654-bc66-455a-9fdf-66aa5529b28e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:11.099328 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fad05654-bc66-455a-9fdf-66aa5529b28e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:11.099858 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fad05654-bc66-455a-9fdf-66aa5529b28e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:11.100293 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fad05654-bc66-455a-9fdf-66aa5529b28e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:11.101500 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fad05654-bc66-455a-9fdf-66aa5529b28e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:11.101949 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fad05654-bc66-455a-9fdf-66aa5529b28e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:11.102366 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fad05654-bc66-455a-9fdf-66aa5529b28e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:11.230042 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-fad05654-bc66-455a-9fdf-66aa5529b28e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:11.237624 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-fad05654-bc66-455a-9fdf-66aa5529b28e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.149311 Sep 13 03:24:11.238182 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 190/407] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:11 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:11.756026 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a4bb1867-bb97-42da-8cbc-6c3df94057bb tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:11.756812 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a4bb1867-bb97-42da-8cbc-6c3df94057bb tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:11.810647 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a4bb1867-bb97-42da-8cbc-6c3df94057bb tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:11.818844 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a4bb1867-bb97-42da-8cbc-6c3df94057bb tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1219 microversion: 2.1 time: 0.066806 Sep 13 03:24:11.819432 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 218/408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:11 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:12.066250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1192742582", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1965801472", "security_groups": [{"name": "tempest-secgroup-smoke-396230096"}], "networks": [{"uuid": "3898e3b7-a638-40b6-8dfc-c2cf58e36d66"}], "block_device_mapping_v2": [{"uuid": "7cbb7b18-e531-449b-a1d7-ab668a967a2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:24:12.183490 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.network.neutron [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] validate_networks() for [('3898e3b7-a638-40b6-8dfc-c2cf58e36d66', None, None, None, None, None)] {{(pid=120384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:24:12.261350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7491b098-8aab-4c22-8a6c-c576501cd4a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:12.261981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7491b098-8aab-4c22-8a6c-c576501cd4a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:12.267838 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7491b098-8aab-4c22-8a6c-c576501cd4a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:12.268330 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7491b098-8aab-4c22-8a6c-c576501cd4a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:12.268768 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7491b098-8aab-4c22-8a6c-c576501cd4a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:12.269462 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7491b098-8aab-4c22-8a6c-c576501cd4a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:12.269918 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7491b098-8aab-4c22-8a6c-c576501cd4a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:12.270345 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7491b098-8aab-4c22-8a6c-c576501cd4a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:12.274911 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=91 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:12.405825 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7491b098-8aab-4c22-8a6c-c576501cd4a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:12.414004 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7491b098-8aab-4c22-8a6c-c576501cd4a2 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.156595 Sep 13 03:24:12.415238 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 219/409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:12 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:24:12.555327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Flavor limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:24:12.555932 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Image limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:24:12.556470 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Flavor pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:24:12.556956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Image pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:24:12.557439 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:24:12.566176 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:12.566808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:12.567245 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:12.567971 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:12.568452 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:12.568873 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:12.585682 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Getting quotas for project fb8fff2dfb49442492296d4c1701abb1. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:24:12.589528 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Getting quotas for user 7ad4d86f4c8f450986870292477c1182 and project fb8fff2dfb49442492296d4c1701abb1. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:24:12.648422 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Going to run 1 instances... {{(pid=120384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:24:12.650461 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7cbb7b18-e531-449b-a1d7-ab668a967a2d',volume_size=None,volume_type=None)] {{(pid=120384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:24:12.779358 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-66c72e7e-29af-465f-bd8f-1c1ef27923ee tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716878 Sep 13 03:24:12.780004 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 191/410] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:24:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:24:12.791735 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a193e442-63cd-428b-be25-627daaa46806 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:12.792418 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a193e442-63cd-428b-be25-627daaa46806 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:12.842282 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-06340196-734d-434d-9704-54cbfbcdd781 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:12.842967 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-06340196-734d-434d-9704-54cbfbcdd781 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:12.846053 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a193e442-63cd-428b-be25-627daaa46806 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:12.857017 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a193e442-63cd-428b-be25-627daaa46806 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1089 microversion: 2.1 time: 0.069557 Sep 13 03:24:12.879015 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 220/411] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:12 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1089 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:12.910865 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-06340196-734d-434d-9704-54cbfbcdd781 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:12.920718 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-06340196-734d-434d-9704-54cbfbcdd781 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1219 microversion: 2.1 time: 0.082627 Sep 13 03:24:12.921483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 192/412] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:12 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:24:13.437306 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b984b074-4f40-43d4-90ca-a67a4a35e0aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:13.437918 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b984b074-4f40-43d4-90ca-a67a4a35e0aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:13.443891 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b984b074-4f40-43d4-90ca-a67a4a35e0aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:13.444382 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b984b074-4f40-43d4-90ca-a67a4a35e0aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:13.445322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b984b074-4f40-43d4-90ca-a67a4a35e0aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:13.446016 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b984b074-4f40-43d4-90ca-a67a4a35e0aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:13.446475 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b984b074-4f40-43d4-90ca-a67a4a35e0aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:13.446926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b984b074-4f40-43d4-90ca-a67a4a35e0aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:13.585685 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b984b074-4f40-43d4-90ca-a67a4a35e0aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:13.594142 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b984b074-4f40-43d4-90ca-a67a4a35e0aa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.160598 Sep 13 03:24:13.594972 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 221/413] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:13 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:13.884471 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-163c025a-5f1c-4666-a8b7-de65f6af01e3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:13.885004 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-163c025a-5f1c-4666-a8b7-de65f6af01e3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:13.891411 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-163c025a-5f1c-4666-a8b7-de65f6af01e3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:13.891891 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-163c025a-5f1c-4666-a8b7-de65f6af01e3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:13.892318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-163c025a-5f1c-4666-a8b7-de65f6af01e3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:13.893001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-163c025a-5f1c-4666-a8b7-de65f6af01e3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:13.893447 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-163c025a-5f1c-4666-a8b7-de65f6af01e3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:13.893871 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-163c025a-5f1c-4666-a8b7-de65f6af01e3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:13.944726 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-336f97aa-892b-4410-80cf-94df5b309413 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:13.945343 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-336f97aa-892b-4410-80cf-94df5b309413 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:13.952803 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-336f97aa-892b-4410-80cf-94df5b309413 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:13.952803 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-336f97aa-892b-4410-80cf-94df5b309413 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:13.952803 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-336f97aa-892b-4410-80cf-94df5b309413 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:13.953604 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-336f97aa-892b-4410-80cf-94df5b309413 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:13.953604 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-336f97aa-892b-4410-80cf-94df5b309413 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:13.953934 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-336f97aa-892b-4410-80cf-94df5b309413 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:13.955461 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-163c025a-5f1c-4666-a8b7-de65f6af01e3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:13.964467 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-163c025a-5f1c-4666-a8b7-de65f6af01e3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1187 microversion: 2.1 time: 0.084471 Sep 13 03:24:13.965659 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 193/414] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:13 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:14.017063 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-336f97aa-892b-4410-80cf-94df5b309413 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:14.024896 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-336f97aa-892b-4410-80cf-94df5b309413 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1223 microversion: 2.1 time: 0.084127 Sep 13 03:24:14.025472 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 222/415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:13 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:24:14.616568 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-773ff1bb-c4d0-4b0b-9e72-1e6770e389e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:14.617468 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-773ff1bb-c4d0-4b0b-9e72-1e6770e389e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:14.625624 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-773ff1bb-c4d0-4b0b-9e72-1e6770e389e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:14.626532 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-773ff1bb-c4d0-4b0b-9e72-1e6770e389e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:14.628221 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-773ff1bb-c4d0-4b0b-9e72-1e6770e389e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:14.629820 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-773ff1bb-c4d0-4b0b-9e72-1e6770e389e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:14.631937 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-773ff1bb-c4d0-4b0b-9e72-1e6770e389e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:14.632582 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-773ff1bb-c4d0-4b0b-9e72-1e6770e389e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:14.836190 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-773ff1bb-c4d0-4b0b-9e72-1e6770e389e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:14.844051 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-773ff1bb-c4d0-4b0b-9e72-1e6770e389e6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.231361 Sep 13 03:24:14.844624 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 194/416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:14 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:14.988580 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0bf60c6b-c79d-4b09-ac1f-3718581833d3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:14.989295 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0bf60c6b-c79d-4b09-ac1f-3718581833d3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:14.995965 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0bf60c6b-c79d-4b09-ac1f-3718581833d3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:14.996508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0bf60c6b-c79d-4b09-ac1f-3718581833d3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:14.997009 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0bf60c6b-c79d-4b09-ac1f-3718581833d3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:14.997915 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0bf60c6b-c79d-4b09-ac1f-3718581833d3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:14.998918 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0bf60c6b-c79d-4b09-ac1f-3718581833d3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:14.999513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0bf60c6b-c79d-4b09-ac1f-3718581833d3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:15.052947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-26ed3282-0cb9-4c0d-be66-ddb58678c64f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:15.055224 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-26ed3282-0cb9-4c0d-be66-ddb58678c64f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:15.078446 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26ed3282-0cb9-4c0d-be66-ddb58678c64f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:15.078980 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26ed3282-0cb9-4c0d-be66-ddb58678c64f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:15.079418 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26ed3282-0cb9-4c0d-be66-ddb58678c64f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:15.082257 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26ed3282-0cb9-4c0d-be66-ddb58678c64f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:15.082939 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26ed3282-0cb9-4c0d-be66-ddb58678c64f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:15.083546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26ed3282-0cb9-4c0d-be66-ddb58678c64f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:15.170988 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-26ed3282-0cb9-4c0d-be66-ddb58678c64f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:15.195855 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-26ed3282-0cb9-4c0d-be66-ddb58678c64f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1271 microversion: 2.1 time: 0.149876 Sep 13 03:24:15.219280 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 195/417] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:15 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:15.238236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0bf60c6b-c79d-4b09-ac1f-3718581833d3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:15.248758 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0bf60c6b-c79d-4b09-ac1f-3718581833d3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1272 microversion: 2.1 time: 0.264571 Sep 13 03:24:15.249650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 223/418] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:14 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:15.868011 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e44844ea-6026-4482-807b-f56a8594965a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:15.868788 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e44844ea-6026-4482-807b-f56a8594965a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:15.878215 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e44844ea-6026-4482-807b-f56a8594965a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:15.878772 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e44844ea-6026-4482-807b-f56a8594965a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:15.879240 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e44844ea-6026-4482-807b-f56a8594965a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:15.880061 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e44844ea-6026-4482-807b-f56a8594965a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:15.880577 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e44844ea-6026-4482-807b-f56a8594965a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:15.881262 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e44844ea-6026-4482-807b-f56a8594965a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:16.110475 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-e44844ea-6026-4482-807b-f56a8594965a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:16.120738 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e44844ea-6026-4482-807b-f56a8594965a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.257569 Sep 13 03:24:16.121734 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 196/419] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:15 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:16.223049 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d253bdf7-30eb-4714-a261-23b9ccd07e0a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:16.223823 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d253bdf7-30eb-4714-a261-23b9ccd07e0a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:16.235131 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d253bdf7-30eb-4714-a261-23b9ccd07e0a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:16.235621 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d253bdf7-30eb-4714-a261-23b9ccd07e0a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:16.236052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d253bdf7-30eb-4714-a261-23b9ccd07e0a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:16.236751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d253bdf7-30eb-4714-a261-23b9ccd07e0a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:16.237927 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d253bdf7-30eb-4714-a261-23b9ccd07e0a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:16.238352 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d253bdf7-30eb-4714-a261-23b9ccd07e0a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:16.275091 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-645007fa-c15b-4eaa-afa4-0a9da67a2e78 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:16.276409 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-645007fa-c15b-4eaa-afa4-0a9da67a2e78 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:16.288903 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-645007fa-c15b-4eaa-afa4-0a9da67a2e78 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:16.289604 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-645007fa-c15b-4eaa-afa4-0a9da67a2e78 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:16.290221 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-645007fa-c15b-4eaa-afa4-0a9da67a2e78 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:16.291125 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-645007fa-c15b-4eaa-afa4-0a9da67a2e78 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:16.291725 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-645007fa-c15b-4eaa-afa4-0a9da67a2e78 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:16.292322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-645007fa-c15b-4eaa-afa4-0a9da67a2e78 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:16.540130 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-645007fa-c15b-4eaa-afa4-0a9da67a2e78 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:16.549221 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-645007fa-c15b-4eaa-afa4-0a9da67a2e78 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.279046 Sep 13 03:24:16.549917 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 197/420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:16 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:16.555737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-d120a85b-c412-4268-8eb3-8e44a2872699 req-a7729076-086e-40e2-83a0-9520afa10454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae88f2e-fe4e-46c6-bf5a-0381e90e26c6", "tag": "802c0f2a-3726-4731-b295-4046e1e4707e"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:24:16.567535 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-d120a85b-c412-4268-8eb3-8e44a2872699 req-a7729076-086e-40e2-83a0-9520afa10454 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:16.568026 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-d120a85b-c412-4268-8eb3-8e44a2872699 req-a7729076-086e-40e2-83a0-9520afa10454 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:16.568460 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-d120a85b-c412-4268-8eb3-8e44a2872699 req-a7729076-086e-40e2-83a0-9520afa10454 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:16.580797 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-d120a85b-c412-4268-8eb3-8e44a2872699 req-a7729076-086e-40e2-83a0-9520afa10454 service nova] Creating event network-changed:802c0f2a-3726-4731-b295-4046e1e4707e for instance aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 on hv-cinder-85707 Sep 13 03:24:16.586782 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-d120a85b-c412-4268-8eb3-8e44a2872699 req-a7729076-086e-40e2-83a0-9520afa10454 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035284 Sep 13 03:24:16.587705 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 198/421] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:24:16.794475 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-470a720a-f401-4138-b8a1-cab94446db72 req-69e811f0-e6dc-4d5e-8e34-f615df76c7ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f", "name": "network-vif-plugged", "status": "completed", "tag": "7cf9530c-a7c2-4a93-8567-f2298a93d7de"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:24:16.809957 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d253bdf7-30eb-4714-a261-23b9ccd07e0a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:16.817921 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-470a720a-f401-4138-b8a1-cab94446db72 req-69e811f0-e6dc-4d5e-8e34-f615df76c7ad service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:16.818685 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-470a720a-f401-4138-b8a1-cab94446db72 req-69e811f0-e6dc-4d5e-8e34-f615df76c7ad service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:16.819275 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-470a720a-f401-4138-b8a1-cab94446db72 req-69e811f0-e6dc-4d5e-8e34-f615df76c7ad service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:16.823619 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d253bdf7-30eb-4714-a261-23b9ccd07e0a tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.604262 Sep 13 03:24:16.838639 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 224/422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:16 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:16.849718 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-470a720a-f401-4138-b8a1-cab94446db72 req-69e811f0-e6dc-4d5e-8e34-f615df76c7ad service nova] Creating event network-vif-plugged:7cf9530c-a7c2-4a93-8567-f2298a93d7de for instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f on hv-cinder-85707 Sep 13 03:24:16.856616 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-470a720a-f401-4138-b8a1-cab94446db72 req-69e811f0-e6dc-4d5e-8e34-f615df76c7ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066451 Sep 13 03:24:16.857776 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 199/423] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:24:17.143307 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0bd52d7e-a5b8-414c-abab-5924da56f025 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:17.143957 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0bd52d7e-a5b8-414c-abab-5924da56f025 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:17.150593 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0bd52d7e-a5b8-414c-abab-5924da56f025 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:17.151123 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0bd52d7e-a5b8-414c-abab-5924da56f025 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:17.151564 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0bd52d7e-a5b8-414c-abab-5924da56f025 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:17.152276 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0bd52d7e-a5b8-414c-abab-5924da56f025 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:17.152735 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0bd52d7e-a5b8-414c-abab-5924da56f025 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:17.153154 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0bd52d7e-a5b8-414c-abab-5924da56f025 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:17.317722 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-879f876a-8f0b-4459-803e-53dd6bbf05cf req-76afcae2-f62c-466c-80e9-ece755ebf47f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad26b9d-e29a-4df3-b103-474a1c46c246", "tag": "abe9beab-d4f1-442b-aea1-34ae58f6c1e3"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:24:17.332100 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-879f876a-8f0b-4459-803e-53dd6bbf05cf req-76afcae2-f62c-466c-80e9-ece755ebf47f service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:17.332579 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-879f876a-8f0b-4459-803e-53dd6bbf05cf req-76afcae2-f62c-466c-80e9-ece755ebf47f service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:17.333006 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-879f876a-8f0b-4459-803e-53dd6bbf05cf req-76afcae2-f62c-466c-80e9-ece755ebf47f service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:17.346543 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-879f876a-8f0b-4459-803e-53dd6bbf05cf req-76afcae2-f62c-466c-80e9-ece755ebf47f service nova] Creating event network-changed:abe9beab-d4f1-442b-aea1-34ae58f6c1e3 for instance 9ad26b9d-e29a-4df3-b103-474a1c46c246 on hv-cinder-85707 Sep 13 03:24:17.352591 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0bd52d7e-a5b8-414c-abab-5924da56f025 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:17.355923 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-879f876a-8f0b-4459-803e-53dd6bbf05cf req-76afcae2-f62c-466c-80e9-ece755ebf47f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042541 Sep 13 03:24:17.356717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 200/424] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:24:17.360603 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0bd52d7e-a5b8-414c-abab-5924da56f025 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.221089 Sep 13 03:24:17.361185 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 225/425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:17 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:17.574401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c269d234-ab24-4249-b473-c276f8703f60 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:17.575125 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c269d234-ab24-4249-b473-c276f8703f60 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:17.581274 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c269d234-ab24-4249-b473-c276f8703f60 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:17.581761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c269d234-ab24-4249-b473-c276f8703f60 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:17.582198 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c269d234-ab24-4249-b473-c276f8703f60 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:17.582915 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c269d234-ab24-4249-b473-c276f8703f60 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:17.583371 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c269d234-ab24-4249-b473-c276f8703f60 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:17.583795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c269d234-ab24-4249-b473-c276f8703f60 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:17.713264 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c269d234-ab24-4249-b473-c276f8703f60 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:17.720973 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c269d234-ab24-4249-b473-c276f8703f60 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.151454 Sep 13 03:24:17.721542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 201/426] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:17 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:17.852629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-df04a1af-76c2-4d94-8b01-071a3f38e231 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:17.853233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-df04a1af-76c2-4d94-8b01-071a3f38e231 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:17.859205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-df04a1af-76c2-4d94-8b01-071a3f38e231 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:17.859693 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-df04a1af-76c2-4d94-8b01-071a3f38e231 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:17.860131 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-df04a1af-76c2-4d94-8b01-071a3f38e231 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:17.860822 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-df04a1af-76c2-4d94-8b01-071a3f38e231 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:17.861277 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-df04a1af-76c2-4d94-8b01-071a3f38e231 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:17.861700 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-df04a1af-76c2-4d94-8b01-071a3f38e231 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:17.995033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-df04a1af-76c2-4d94-8b01-071a3f38e231 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:18.002560 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-df04a1af-76c2-4d94-8b01-071a3f38e231 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.154285 Sep 13 03:24:18.003150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 226/427] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:17 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:18.384009 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6a5adffd-b57f-414e-bdff-ca55305fc581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:18.384663 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6a5adffd-b57f-414e-bdff-ca55305fc581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:18.391402 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6a5adffd-b57f-414e-bdff-ca55305fc581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:18.391894 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6a5adffd-b57f-414e-bdff-ca55305fc581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:18.392334 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6a5adffd-b57f-414e-bdff-ca55305fc581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:18.393032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6a5adffd-b57f-414e-bdff-ca55305fc581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:18.393491 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6a5adffd-b57f-414e-bdff-ca55305fc581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:18.393918 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6a5adffd-b57f-414e-bdff-ca55305fc581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:18.541061 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-6a5adffd-b57f-414e-bdff-ca55305fc581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:18.549282 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6a5adffd-b57f-414e-bdff-ca55305fc581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.169229 Sep 13 03:24:18.549969 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 202/428] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:18 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:18.743708 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-585b304c-703b-400d-b37b-cf3b1cfa38e6 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:18.744315 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-585b304c-703b-400d-b37b-cf3b1cfa38e6 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:18.750213 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-585b304c-703b-400d-b37b-cf3b1cfa38e6 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:18.750739 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-585b304c-703b-400d-b37b-cf3b1cfa38e6 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:18.751209 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-585b304c-703b-400d-b37b-cf3b1cfa38e6 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:18.751907 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-585b304c-703b-400d-b37b-cf3b1cfa38e6 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:18.752360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-585b304c-703b-400d-b37b-cf3b1cfa38e6 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:18.752783 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-585b304c-703b-400d-b37b-cf3b1cfa38e6 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:18.890214 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-585b304c-703b-400d-b37b-cf3b1cfa38e6 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:18.897849 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-585b304c-703b-400d-b37b-cf3b1cfa38e6 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.157990 Sep 13 03:24:18.898406 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 227/429] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:18 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:19.026347 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4963a384-2458-4853-9594-d85143168a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:19.026878 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-4963a384-2458-4853-9594-d85143168a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:19.032800 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4963a384-2458-4853-9594-d85143168a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:19.033286 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4963a384-2458-4853-9594-d85143168a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:19.033711 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4963a384-2458-4853-9594-d85143168a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:19.034393 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4963a384-2458-4853-9594-d85143168a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:19.034866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4963a384-2458-4853-9594-d85143168a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:19.035281 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4963a384-2458-4853-9594-d85143168a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:19.037882 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=100 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:19.172040 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4963a384-2458-4853-9594-d85143168a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:19.179651 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4963a384-2458-4853-9594-d85143168a5b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.157746 Sep 13 03:24:19.180218 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 203/430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:19 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:19.572846 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7d1f4643-f928-4b6f-922d-357afc9afb9f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:19.573530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7d1f4643-f928-4b6f-922d-357afc9afb9f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:19.579647 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7d1f4643-f928-4b6f-922d-357afc9afb9f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:19.580221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7d1f4643-f928-4b6f-922d-357afc9afb9f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:19.580751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7d1f4643-f928-4b6f-922d-357afc9afb9f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:19.581522 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7d1f4643-f928-4b6f-922d-357afc9afb9f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:19.582055 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7d1f4643-f928-4b6f-922d-357afc9afb9f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:19.582554 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7d1f4643-f928-4b6f-922d-357afc9afb9f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:19.713708 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7d1f4643-f928-4b6f-922d-357afc9afb9f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:19.721413 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7d1f4643-f928-4b6f-922d-357afc9afb9f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.153184 Sep 13 03:24:19.721987 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 228/431] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:19 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:19.920634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-782694b8-a789-43fe-9f4d-6134ec70cc02 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:19.921285 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-782694b8-a789-43fe-9f4d-6134ec70cc02 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:19.928345 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-782694b8-a789-43fe-9f4d-6134ec70cc02 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:19.929460 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-782694b8-a789-43fe-9f4d-6134ec70cc02 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:19.929900 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-782694b8-a789-43fe-9f4d-6134ec70cc02 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:19.930602 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-782694b8-a789-43fe-9f4d-6134ec70cc02 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:19.931093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-782694b8-a789-43fe-9f4d-6134ec70cc02 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:19.931520 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-782694b8-a789-43fe-9f4d-6134ec70cc02 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:20.067588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-782694b8-a789-43fe-9f4d-6134ec70cc02 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:20.075506 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-782694b8-a789-43fe-9f4d-6134ec70cc02 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.159178 Sep 13 03:24:20.076271 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 204/432] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:19 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:20.202948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-dc03a83b-41bf-4349-adcc-7eaa086fe193 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:20.203562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-dc03a83b-41bf-4349-adcc-7eaa086fe193 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:20.209460 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dc03a83b-41bf-4349-adcc-7eaa086fe193 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:20.209945 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dc03a83b-41bf-4349-adcc-7eaa086fe193 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:20.210382 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dc03a83b-41bf-4349-adcc-7eaa086fe193 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:20.211091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dc03a83b-41bf-4349-adcc-7eaa086fe193 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:20.211550 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dc03a83b-41bf-4349-adcc-7eaa086fe193 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:20.211974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dc03a83b-41bf-4349-adcc-7eaa086fe193 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:20.344303 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-dc03a83b-41bf-4349-adcc-7eaa086fe193 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:20.352534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-dc03a83b-41bf-4349-adcc-7eaa086fe193 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.153606 Sep 13 03:24:20.353100 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 229/433] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:20 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:20.743786 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-17ef76ad-309f-4370-b22f-a9d0292cfdf3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:20.744327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-17ef76ad-309f-4370-b22f-a9d0292cfdf3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:20.750401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17ef76ad-309f-4370-b22f-a9d0292cfdf3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:20.751007 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17ef76ad-309f-4370-b22f-a9d0292cfdf3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:20.751536 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17ef76ad-309f-4370-b22f-a9d0292cfdf3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:20.752467 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17ef76ad-309f-4370-b22f-a9d0292cfdf3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:20.753072 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17ef76ad-309f-4370-b22f-a9d0292cfdf3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:20.753665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17ef76ad-309f-4370-b22f-a9d0292cfdf3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:20.889081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-17ef76ad-309f-4370-b22f-a9d0292cfdf3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:20.896801 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-17ef76ad-309f-4370-b22f-a9d0292cfdf3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.156950 Sep 13 03:24:20.897455 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 205/434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:20 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:21.097221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1bb58148-cc31-4a7e-b697-aa28aa8a2934 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:21.097828 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1bb58148-cc31-4a7e-b697-aa28aa8a2934 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:21.105761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1bb58148-cc31-4a7e-b697-aa28aa8a2934 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:21.106250 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1bb58148-cc31-4a7e-b697-aa28aa8a2934 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:21.106704 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1bb58148-cc31-4a7e-b697-aa28aa8a2934 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:21.107396 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1bb58148-cc31-4a7e-b697-aa28aa8a2934 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:21.107846 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1bb58148-cc31-4a7e-b697-aa28aa8a2934 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:21.108260 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1bb58148-cc31-4a7e-b697-aa28aa8a2934 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:21.237163 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1bb58148-cc31-4a7e-b697-aa28aa8a2934 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:21.244754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1bb58148-cc31-4a7e-b697-aa28aa8a2934 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.151398 Sep 13 03:24:21.245313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 230/435] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:21 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:21.375658 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4014b641-46e0-487d-a6d3-14dd695a6887 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:21.376396 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-4014b641-46e0-487d-a6d3-14dd695a6887 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:21.382861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4014b641-46e0-487d-a6d3-14dd695a6887 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:21.383474 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4014b641-46e0-487d-a6d3-14dd695a6887 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:21.383917 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4014b641-46e0-487d-a6d3-14dd695a6887 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:21.384613 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4014b641-46e0-487d-a6d3-14dd695a6887 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:21.385068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4014b641-46e0-487d-a6d3-14dd695a6887 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:21.385485 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4014b641-46e0-487d-a6d3-14dd695a6887 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:21.542156 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4014b641-46e0-487d-a6d3-14dd695a6887 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:21.552267 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4014b641-46e0-487d-a6d3-14dd695a6887 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.180672 Sep 13 03:24:21.569014 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 206/436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:21 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:21.919717 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8a894947-7947-4765-a213-c02763485999 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:21.920326 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8a894947-7947-4765-a213-c02763485999 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:21.927248 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8a894947-7947-4765-a213-c02763485999 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:21.927982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8a894947-7947-4765-a213-c02763485999 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:21.928412 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8a894947-7947-4765-a213-c02763485999 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:21.929634 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8a894947-7947-4765-a213-c02763485999 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:21.930085 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8a894947-7947-4765-a213-c02763485999 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:21.930503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8a894947-7947-4765-a213-c02763485999 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:22.080471 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-8a894947-7947-4765-a213-c02763485999 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:22.088235 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8a894947-7947-4765-a213-c02763485999 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.172529 Sep 13 03:24:22.088864 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 231/437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:21 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:22.267410 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-05b42db1-5ab8-4b0a-933c-938aff83a0b3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:22.267931 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-05b42db1-5ab8-4b0a-933c-938aff83a0b3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:22.273835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-05b42db1-5ab8-4b0a-933c-938aff83a0b3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:22.274321 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-05b42db1-5ab8-4b0a-933c-938aff83a0b3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:22.274796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-05b42db1-5ab8-4b0a-933c-938aff83a0b3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:22.275485 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-05b42db1-5ab8-4b0a-933c-938aff83a0b3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:22.275937 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-05b42db1-5ab8-4b0a-933c-938aff83a0b3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:22.276359 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-05b42db1-5ab8-4b0a-933c-938aff83a0b3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:22.405177 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-05b42db1-5ab8-4b0a-933c-938aff83a0b3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:22.413492 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-05b42db1-5ab8-4b0a-933c-938aff83a0b3 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.149581 Sep 13 03:24:22.414054 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 207/438] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:22 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:24:22.575484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d9f73812-a437-446c-9999-3e1d29ded468 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:22.576049 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d9f73812-a437-446c-9999-3e1d29ded468 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:22.582426 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9f73812-a437-446c-9999-3e1d29ded468 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:22.582949 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9f73812-a437-446c-9999-3e1d29ded468 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:22.583379 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9f73812-a437-446c-9999-3e1d29ded468 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:22.584061 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9f73812-a437-446c-9999-3e1d29ded468 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:22.584509 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9f73812-a437-446c-9999-3e1d29ded468 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:22.585436 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9f73812-a437-446c-9999-3e1d29ded468 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:22.714823 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d9f73812-a437-446c-9999-3e1d29ded468 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:22.722468 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d9f73812-a437-446c-9999-3e1d29ded468 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.150856 Sep 13 03:24:22.723084 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 232/439] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:22 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:24:23.110932 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-133e5d56-0cde-4bbc-a6a6-3e18af2fa043 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:23.111550 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-133e5d56-0cde-4bbc-a6a6-3e18af2fa043 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:23.113382 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=4 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:23.114228 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=14 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:23.120127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-133e5d56-0cde-4bbc-a6a6-3e18af2fa043 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:23.120616 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-133e5d56-0cde-4bbc-a6a6-3e18af2fa043 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:23.121055 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-133e5d56-0cde-4bbc-a6a6-3e18af2fa043 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:23.122103 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-133e5d56-0cde-4bbc-a6a6-3e18af2fa043 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:23.122195 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-133e5d56-0cde-4bbc-a6a6-3e18af2fa043 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:23.122735 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-133e5d56-0cde-4bbc-a6a6-3e18af2fa043 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:23.253558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-133e5d56-0cde-4bbc-a6a6-3e18af2fa043 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:23.261694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-133e5d56-0cde-4bbc-a6a6-3e18af2fa043 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.154770 Sep 13 03:24:23.262256 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 208/440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:23 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:23.436045 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-280143d6-f110-48f8-b3cf-d4f82321e01f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:23.436654 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-280143d6-f110-48f8-b3cf-d4f82321e01f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:23.438464 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=8 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:23.443696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-280143d6-f110-48f8-b3cf-d4f82321e01f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:23.444244 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-280143d6-f110-48f8-b3cf-d4f82321e01f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:23.444679 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-280143d6-f110-48f8-b3cf-d4f82321e01f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:23.445368 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-280143d6-f110-48f8-b3cf-d4f82321e01f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:23.445819 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-280143d6-f110-48f8-b3cf-d4f82321e01f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:23.446241 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-280143d6-f110-48f8-b3cf-d4f82321e01f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:23.575347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-280143d6-f110-48f8-b3cf-d4f82321e01f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:23.582950 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-280143d6-f110-48f8-b3cf-d4f82321e01f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.150718 Sep 13 03:24:23.583513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 233/441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:23 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:23.745821 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-91a01873-3af7-4a99-92fa-0a7fccf9f930 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:23.746397 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-91a01873-3af7-4a99-92fa-0a7fccf9f930 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:23.752776 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-91a01873-3af7-4a99-92fa-0a7fccf9f930 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:23.753260 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-91a01873-3af7-4a99-92fa-0a7fccf9f930 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:23.753696 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-91a01873-3af7-4a99-92fa-0a7fccf9f930 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:23.754412 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-91a01873-3af7-4a99-92fa-0a7fccf9f930 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:23.754885 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-91a01873-3af7-4a99-92fa-0a7fccf9f930 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:23.755309 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-91a01873-3af7-4a99-92fa-0a7fccf9f930 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:23.884857 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-91a01873-3af7-4a99-92fa-0a7fccf9f930 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:23.892521 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-91a01873-3af7-4a99-92fa-0a7fccf9f930 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.150669 Sep 13 03:24:23.893091 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 209/442] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:23 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:24.284371 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5e9635d3-854a-4409-b5bb-6c4967e402ce tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:24.284984 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5e9635d3-854a-4409-b5bb-6c4967e402ce tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:24.291027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5e9635d3-854a-4409-b5bb-6c4967e402ce tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:24.291518 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5e9635d3-854a-4409-b5bb-6c4967e402ce tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:24.291955 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5e9635d3-854a-4409-b5bb-6c4967e402ce tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:24.292650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5e9635d3-854a-4409-b5bb-6c4967e402ce tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:24.293355 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5e9635d3-854a-4409-b5bb-6c4967e402ce tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:24.293780 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5e9635d3-854a-4409-b5bb-6c4967e402ce tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:24.426143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5e9635d3-854a-4409-b5bb-6c4967e402ce tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:24.433996 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5e9635d3-854a-4409-b5bb-6c4967e402ce tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.153508 Sep 13 03:24:24.434569 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 234/443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:24 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:24.605265 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-92df6b21-4718-4a63-a8e9-2409daeeff2a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:24.605875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-92df6b21-4718-4a63-a8e9-2409daeeff2a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:24.611864 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-92df6b21-4718-4a63-a8e9-2409daeeff2a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:24.612348 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-92df6b21-4718-4a63-a8e9-2409daeeff2a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:24.612781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-92df6b21-4718-4a63-a8e9-2409daeeff2a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:24.613468 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-92df6b21-4718-4a63-a8e9-2409daeeff2a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:24.613924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-92df6b21-4718-4a63-a8e9-2409daeeff2a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:24.614343 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-92df6b21-4718-4a63-a8e9-2409daeeff2a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:24.744951 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-92df6b21-4718-4a63-a8e9-2409daeeff2a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:24.753470 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-92df6b21-4718-4a63-a8e9-2409daeeff2a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.152002 Sep 13 03:24:24.754040 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 210/444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:24 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:24.915905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5ee025fc-72c6-43bb-acee-79f0954716b1 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:24.916511 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5ee025fc-72c6-43bb-acee-79f0954716b1 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:24.922830 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5ee025fc-72c6-43bb-acee-79f0954716b1 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:24.923319 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5ee025fc-72c6-43bb-acee-79f0954716b1 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:24.923790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5ee025fc-72c6-43bb-acee-79f0954716b1 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:24.924479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5ee025fc-72c6-43bb-acee-79f0954716b1 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:24.924942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5ee025fc-72c6-43bb-acee-79f0954716b1 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:24.925365 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5ee025fc-72c6-43bb-acee-79f0954716b1 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:25.054296 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5ee025fc-72c6-43bb-acee-79f0954716b1 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:25.062174 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5ee025fc-72c6-43bb-acee-79f0954716b1 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.150099 Sep 13 03:24:25.062777 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 235/445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:24 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:25.458368 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7de8f25b-d632-471d-a19f-fb99b0d8374e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:25.458994 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7de8f25b-d632-471d-a19f-fb99b0d8374e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:25.464932 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7de8f25b-d632-471d-a19f-fb99b0d8374e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:25.465413 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7de8f25b-d632-471d-a19f-fb99b0d8374e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:25.465845 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7de8f25b-d632-471d-a19f-fb99b0d8374e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:25.466524 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7de8f25b-d632-471d-a19f-fb99b0d8374e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:25.467012 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7de8f25b-d632-471d-a19f-fb99b0d8374e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:25.467432 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7de8f25b-d632-471d-a19f-fb99b0d8374e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:25.599341 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7de8f25b-d632-471d-a19f-fb99b0d8374e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:25.607541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7de8f25b-d632-471d-a19f-fb99b0d8374e tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.153064 Sep 13 03:24:25.608121 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 211/446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:25 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:25.776966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e11051fa-1cde-4f74-9c96-23e7b7088016 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:25.777517 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e11051fa-1cde-4f74-9c96-23e7b7088016 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:25.783463 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e11051fa-1cde-4f74-9c96-23e7b7088016 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:25.783947 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e11051fa-1cde-4f74-9c96-23e7b7088016 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:25.784381 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e11051fa-1cde-4f74-9c96-23e7b7088016 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:25.785066 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e11051fa-1cde-4f74-9c96-23e7b7088016 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:25.785524 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e11051fa-1cde-4f74-9c96-23e7b7088016 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:25.785947 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e11051fa-1cde-4f74-9c96-23e7b7088016 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:25.921392 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e11051fa-1cde-4f74-9c96-23e7b7088016 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:25.923572 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:25.930420 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e11051fa-1cde-4f74-9c96-23e7b7088016 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.157950 Sep 13 03:24:25.931023 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 236/447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:25 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:26.085892 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7dc00068-acc6-493b-9e6b-34df58895995 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:26.086499 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7dc00068-acc6-493b-9e6b-34df58895995 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:26.092885 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7dc00068-acc6-493b-9e6b-34df58895995 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:26.093373 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7dc00068-acc6-493b-9e6b-34df58895995 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:26.093808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7dc00068-acc6-493b-9e6b-34df58895995 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:26.094495 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7dc00068-acc6-493b-9e6b-34df58895995 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:26.094972 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7dc00068-acc6-493b-9e6b-34df58895995 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:26.095427 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7dc00068-acc6-493b-9e6b-34df58895995 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:26.233226 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7dc00068-acc6-493b-9e6b-34df58895995 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:26.240878 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7dc00068-acc6-493b-9e6b-34df58895995 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.159473 Sep 13 03:24:26.241442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 212/448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:26 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:26.630431 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-23a1cb99-653b-4373-b8f2-9e3b4749e216 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:26.631069 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-23a1cb99-653b-4373-b8f2-9e3b4749e216 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:26.637620 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-23a1cb99-653b-4373-b8f2-9e3b4749e216 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:26.638098 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-23a1cb99-653b-4373-b8f2-9e3b4749e216 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:26.638533 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-23a1cb99-653b-4373-b8f2-9e3b4749e216 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:26.639267 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-23a1cb99-653b-4373-b8f2-9e3b4749e216 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:26.639719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-23a1cb99-653b-4373-b8f2-9e3b4749e216 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:26.640137 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-23a1cb99-653b-4373-b8f2-9e3b4749e216 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:26.769366 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-23a1cb99-653b-4373-b8f2-9e3b4749e216 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:26.776969 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-23a1cb99-653b-4373-b8f2-9e3b4749e216 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.150724 Sep 13 03:24:26.777529 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 237/449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:26 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:26.953147 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d1d3f35d-c0a9-4b06-8e04-ba5c0bcd5f7b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:26.953759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d1d3f35d-c0a9-4b06-8e04-ba5c0bcd5f7b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:26.959895 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d1d3f35d-c0a9-4b06-8e04-ba5c0bcd5f7b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:26.960389 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d1d3f35d-c0a9-4b06-8e04-ba5c0bcd5f7b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:26.960829 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d1d3f35d-c0a9-4b06-8e04-ba5c0bcd5f7b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:26.961523 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d1d3f35d-c0a9-4b06-8e04-ba5c0bcd5f7b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:26.961979 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d1d3f35d-c0a9-4b06-8e04-ba5c0bcd5f7b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:26.962400 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d1d3f35d-c0a9-4b06-8e04-ba5c0bcd5f7b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:27.094839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d1d3f35d-c0a9-4b06-8e04-ba5c0bcd5f7b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:27.103264 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d1d3f35d-c0a9-4b06-8e04-ba5c0bcd5f7b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.153901 Sep 13 03:24:27.103854 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 213/450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:26 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:27.263160 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-94a989ef-2cb0-424c-9165-a69efcba59d6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:27.263732 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-94a989ef-2cb0-424c-9165-a69efcba59d6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:27.269587 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-94a989ef-2cb0-424c-9165-a69efcba59d6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:27.270073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-94a989ef-2cb0-424c-9165-a69efcba59d6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:27.270503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-94a989ef-2cb0-424c-9165-a69efcba59d6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:27.271216 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-94a989ef-2cb0-424c-9165-a69efcba59d6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:27.271674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-94a989ef-2cb0-424c-9165-a69efcba59d6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:27.272094 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-94a989ef-2cb0-424c-9165-a69efcba59d6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:27.403650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-94a989ef-2cb0-424c-9165-a69efcba59d6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:27.411593 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-94a989ef-2cb0-424c-9165-a69efcba59d6 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.152407 Sep 13 03:24:27.412180 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 238/451] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:27 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:27.799180 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-38b85c0a-3906-49a8-b1c6-38e1cdb00349 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:27.799795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-38b85c0a-3906-49a8-b1c6-38e1cdb00349 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:27.806271 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38b85c0a-3906-49a8-b1c6-38e1cdb00349 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:27.806786 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38b85c0a-3906-49a8-b1c6-38e1cdb00349 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:27.807226 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38b85c0a-3906-49a8-b1c6-38e1cdb00349 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:27.807916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38b85c0a-3906-49a8-b1c6-38e1cdb00349 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:27.808372 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38b85c0a-3906-49a8-b1c6-38e1cdb00349 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:27.808793 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38b85c0a-3906-49a8-b1c6-38e1cdb00349 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:27.936161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-38b85c0a-3906-49a8-b1c6-38e1cdb00349 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:27.943823 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-38b85c0a-3906-49a8-b1c6-38e1cdb00349 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.148449 Sep 13 03:24:27.945216 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 214/452] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:27 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:28.128518 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-eca0afa8-ce41-4974-8779-c02fd934dfdc tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:28.129164 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-eca0afa8-ce41-4974-8779-c02fd934dfdc tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:28.135802 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eca0afa8-ce41-4974-8779-c02fd934dfdc tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:28.136277 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eca0afa8-ce41-4974-8779-c02fd934dfdc tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:28.136714 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eca0afa8-ce41-4974-8779-c02fd934dfdc tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:28.137418 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eca0afa8-ce41-4974-8779-c02fd934dfdc tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:28.137876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eca0afa8-ce41-4974-8779-c02fd934dfdc tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:28.138299 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eca0afa8-ce41-4974-8779-c02fd934dfdc tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:28.267241 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-eca0afa8-ce41-4974-8779-c02fd934dfdc tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:28.274911 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-eca0afa8-ce41-4974-8779-c02fd934dfdc tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.150226 Sep 13 03:24:28.275484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 239/453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:28 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:28.435384 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8786359a-23ef-49a8-b212-ae55836d71d2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:28.436023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8786359a-23ef-49a8-b212-ae55836d71d2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:28.442500 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8786359a-23ef-49a8-b212-ae55836d71d2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:28.443013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8786359a-23ef-49a8-b212-ae55836d71d2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:28.443448 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8786359a-23ef-49a8-b212-ae55836d71d2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:28.444132 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8786359a-23ef-49a8-b212-ae55836d71d2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:28.444585 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8786359a-23ef-49a8-b212-ae55836d71d2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:28.445006 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8786359a-23ef-49a8-b212-ae55836d71d2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:28.571125 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-8786359a-23ef-49a8-b212-ae55836d71d2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:28.578719 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8786359a-23ef-49a8-b212-ae55836d71d2 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.147177 Sep 13 03:24:28.579287 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 215/454] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:28 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:28.967025 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f268d20e-6f9f-4ee6-82cf-154cd118d4ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:28.967630 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f268d20e-6f9f-4ee6-82cf-154cd118d4ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:28.973489 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f268d20e-6f9f-4ee6-82cf-154cd118d4ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:28.973966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f268d20e-6f9f-4ee6-82cf-154cd118d4ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:28.974401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f268d20e-6f9f-4ee6-82cf-154cd118d4ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:28.975109 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f268d20e-6f9f-4ee6-82cf-154cd118d4ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:28.975616 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f268d20e-6f9f-4ee6-82cf-154cd118d4ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:28.976033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f268d20e-6f9f-4ee6-82cf-154cd118d4ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:29.103376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f268d20e-6f9f-4ee6-82cf-154cd118d4ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:29.110920 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f268d20e-6f9f-4ee6-82cf-154cd118d4ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.147668 Sep 13 03:24:29.111512 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 240/455] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:28 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:29.298319 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7f77a07d-ca57-4555-b575-0dc3b69bda13 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:29.298946 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7f77a07d-ca57-4555-b575-0dc3b69bda13 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:29.305378 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f77a07d-ca57-4555-b575-0dc3b69bda13 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:29.305799 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f77a07d-ca57-4555-b575-0dc3b69bda13 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:29.306241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f77a07d-ca57-4555-b575-0dc3b69bda13 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:29.306933 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f77a07d-ca57-4555-b575-0dc3b69bda13 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:29.307382 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f77a07d-ca57-4555-b575-0dc3b69bda13 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:29.307802 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f77a07d-ca57-4555-b575-0dc3b69bda13 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:29.441260 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7f77a07d-ca57-4555-b575-0dc3b69bda13 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:29.450194 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7f77a07d-ca57-4555-b575-0dc3b69bda13 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.155762 Sep 13 03:24:29.450791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 216/456] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:29 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:29.601885 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a38c06da-3eef-4401-8500-23e55490ba40 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:29.602424 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a38c06da-3eef-4401-8500-23e55490ba40 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:29.604674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 03:24:29.604823 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Tue Sep 13 03:24:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 (ip 10.222.0.18) !!! Sep 13 03:24:29.611353 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a38c06da-3eef-4401-8500-23e55490ba40 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:29.611837 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a38c06da-3eef-4401-8500-23e55490ba40 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:29.612266 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a38c06da-3eef-4401-8500-23e55490ba40 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:29.612956 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a38c06da-3eef-4401-8500-23e55490ba40 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:29.613406 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a38c06da-3eef-4401-8500-23e55490ba40 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:29.613830 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a38c06da-3eef-4401-8500-23e55490ba40 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:29.747091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a38c06da-3eef-4401-8500-23e55490ba40 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:29.754752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a38c06da-3eef-4401-8500-23e55490ba40 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.156858 Sep 13 03:24:29.755320 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 241/457] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:29 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:30.133284 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-19a4a66f-d7dc-49be-90b2-427e20d3837a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:30.133914 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-19a4a66f-d7dc-49be-90b2-427e20d3837a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:30.135772 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:30.142039 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19a4a66f-d7dc-49be-90b2-427e20d3837a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:30.142600 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19a4a66f-d7dc-49be-90b2-427e20d3837a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:30.143050 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19a4a66f-d7dc-49be-90b2-427e20d3837a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:30.143740 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19a4a66f-d7dc-49be-90b2-427e20d3837a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:30.144188 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19a4a66f-d7dc-49be-90b2-427e20d3837a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:30.144605 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19a4a66f-d7dc-49be-90b2-427e20d3837a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:30.271967 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-19a4a66f-d7dc-49be-90b2-427e20d3837a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:30.280012 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-19a4a66f-d7dc-49be-90b2-427e20d3837a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1371 microversion: 2.1 time: 0.150541 Sep 13 03:24:30.280572 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 217/458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:30 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:30.472570 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9e550f7c-d9a2-4b1c-b9b7-1d0d5b099642 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:30.473189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9e550f7c-d9a2-4b1c-b9b7-1d0d5b099642 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:30.479117 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9e550f7c-d9a2-4b1c-b9b7-1d0d5b099642 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:30.479605 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9e550f7c-d9a2-4b1c-b9b7-1d0d5b099642 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:30.480044 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9e550f7c-d9a2-4b1c-b9b7-1d0d5b099642 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:30.480745 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9e550f7c-d9a2-4b1c-b9b7-1d0d5b099642 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:30.481199 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9e550f7c-d9a2-4b1c-b9b7-1d0d5b099642 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:30.481635 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9e550f7c-d9a2-4b1c-b9b7-1d0d5b099642 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:30.616288 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9e550f7c-d9a2-4b1c-b9b7-1d0d5b099642 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:30.623903 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9e550f7c-d9a2-4b1c-b9b7-1d0d5b099642 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.155172 Sep 13 03:24:30.624491 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 242/459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:30 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:30.777162 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2e3d7d43-5bac-496d-9df0-5388d42eeb2b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:30.777777 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2e3d7d43-5bac-496d-9df0-5388d42eeb2b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:30.784210 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e3d7d43-5bac-496d-9df0-5388d42eeb2b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:30.784706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e3d7d43-5bac-496d-9df0-5388d42eeb2b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:30.785140 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e3d7d43-5bac-496d-9df0-5388d42eeb2b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:30.785835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e3d7d43-5bac-496d-9df0-5388d42eeb2b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:30.786292 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e3d7d43-5bac-496d-9df0-5388d42eeb2b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:30.786743 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e3d7d43-5bac-496d-9df0-5388d42eeb2b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:30.936961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2e3d7d43-5bac-496d-9df0-5388d42eeb2b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:30.945384 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2e3d7d43-5bac-496d-9df0-5388d42eeb2b tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.172101 Sep 13 03:24:30.945954 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 218/460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:30 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:31.304291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2fd88cb0-a3ff-4bb6-b5d8-fdd631d92b30 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:31.304897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2fd88cb0-a3ff-4bb6-b5d8-fdd631d92b30 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:31.310991 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2fd88cb0-a3ff-4bb6-b5d8-fdd631d92b30 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:31.311476 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2fd88cb0-a3ff-4bb6-b5d8-fdd631d92b30 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:31.311907 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2fd88cb0-a3ff-4bb6-b5d8-fdd631d92b30 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:31.312590 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2fd88cb0-a3ff-4bb6-b5d8-fdd631d92b30 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:31.313044 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2fd88cb0-a3ff-4bb6-b5d8-fdd631d92b30 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:31.313458 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2fd88cb0-a3ff-4bb6-b5d8-fdd631d92b30 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:31.445107 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2fd88cb0-a3ff-4bb6-b5d8-fdd631d92b30 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:31.452812 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2fd88cb0-a3ff-4bb6-b5d8-fdd631d92b30 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1565 microversion: 2.1 time: 0.153059 Sep 13 03:24:31.453370 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 243/461] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:31 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:31.474977 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-701174c8-129c-4793-8307-9b7e47f111ad tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:31.475992 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-701174c8-129c-4793-8307-9b7e47f111ad tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:31.481970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-701174c8-129c-4793-8307-9b7e47f111ad tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:31.482454 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-701174c8-129c-4793-8307-9b7e47f111ad tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:31.482943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-701174c8-129c-4793-8307-9b7e47f111ad tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:31.483635 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-701174c8-129c-4793-8307-9b7e47f111ad tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:31.484091 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-701174c8-129c-4793-8307-9b7e47f111ad tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:31.484514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-701174c8-129c-4793-8307-9b7e47f111ad tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:31.564512 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-701174c8-129c-4793-8307-9b7e47f111ad tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093562 Sep 13 03:24:31.565320 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 219/462] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 03:24:31 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:24:31.647612 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1a9c2639-4a21-4575-b489-175cd3129d8a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:31.648425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1a9c2639-4a21-4575-b489-175cd3129d8a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:31.654753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1a9c2639-4a21-4575-b489-175cd3129d8a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:31.655397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1a9c2639-4a21-4575-b489-175cd3129d8a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:31.655994 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1a9c2639-4a21-4575-b489-175cd3129d8a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:31.656787 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1a9c2639-4a21-4575-b489-175cd3129d8a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:31.657350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1a9c2639-4a21-4575-b489-175cd3129d8a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:31.657912 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1a9c2639-4a21-4575-b489-175cd3129d8a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:31.899973 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1a9c2639-4a21-4575-b489-175cd3129d8a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:31.907713 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1a9c2639-4a21-4575-b489-175cd3129d8a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.264561 Sep 13 03:24:31.908315 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 244/463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:31 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:31.968323 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e1d82a49-2da0-4d07-bcb5-e0a0a13922fc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:31.968931 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e1d82a49-2da0-4d07-bcb5-e0a0a13922fc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:31.974942 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1d82a49-2da0-4d07-bcb5-e0a0a13922fc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:31.975753 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1d82a49-2da0-4d07-bcb5-e0a0a13922fc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:31.976184 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1d82a49-2da0-4d07-bcb5-e0a0a13922fc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:31.976899 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1d82a49-2da0-4d07-bcb5-e0a0a13922fc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:31.977346 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1d82a49-2da0-4d07-bcb5-e0a0a13922fc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:31.977761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1d82a49-2da0-4d07-bcb5-e0a0a13922fc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:31.982645 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=100 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:32.111180 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-e1d82a49-2da0-4d07-bcb5-e0a0a13922fc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:32.119137 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e1d82a49-2da0-4d07-bcb5-e0a0a13922fc tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.155140 Sep 13 03:24:32.119709 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 220/464] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:31 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:32.581127 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-2f2ea752-add0-40a5-ad21-c08e9a550a81 req-d4d7aec0-75fa-4498-9b50-77aa81c9edd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f", "tag": "7cf9530c-a7c2-4a93-8567-f2298a93d7de"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:24:32.591071 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2f2ea752-add0-40a5-ad21-c08e9a550a81 req-d4d7aec0-75fa-4498-9b50-77aa81c9edd3 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:32.591556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2f2ea752-add0-40a5-ad21-c08e9a550a81 req-d4d7aec0-75fa-4498-9b50-77aa81c9edd3 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:32.591990 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2f2ea752-add0-40a5-ad21-c08e9a550a81 req-d4d7aec0-75fa-4498-9b50-77aa81c9edd3 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:32.607613 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-2f2ea752-add0-40a5-ad21-c08e9a550a81 req-d4d7aec0-75fa-4498-9b50-77aa81c9edd3 service nova] Creating event network-changed:7cf9530c-a7c2-4a93-8567-f2298a93d7de for instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f on hv-cinder-85707 Sep 13 03:24:32.610921 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-2f2ea752-add0-40a5-ad21-c08e9a550a81 req-d4d7aec0-75fa-4498-9b50-77aa81c9edd3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033253 Sep 13 03:24:32.611711 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 245/465] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:24:32.931742 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d0056d67-d584-4cbb-b8bd-0dcb37723450 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:32.932494 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d0056d67-d584-4cbb-b8bd-0dcb37723450 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:32.938549 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d0056d67-d584-4cbb-b8bd-0dcb37723450 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:32.939104 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d0056d67-d584-4cbb-b8bd-0dcb37723450 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:32.939630 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d0056d67-d584-4cbb-b8bd-0dcb37723450 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:32.940254 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d0056d67-d584-4cbb-b8bd-0dcb37723450 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:32.940718 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d0056d67-d584-4cbb-b8bd-0dcb37723450 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:32.941135 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d0056d67-d584-4cbb-b8bd-0dcb37723450 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:33.077848 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d0056d67-d584-4cbb-b8bd-0dcb37723450 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:33.086294 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d0056d67-d584-4cbb-b8bd-0dcb37723450 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.159011 Sep 13 03:24:33.086892 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 221/466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:32 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:33.142940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ee61cca9-c20a-44fa-bcdb-599e7c015961 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:33.143710 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ee61cca9-c20a-44fa-bcdb-599e7c015961 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:33.150428 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ee61cca9-c20a-44fa-bcdb-599e7c015961 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:33.150946 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ee61cca9-c20a-44fa-bcdb-599e7c015961 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:33.151380 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ee61cca9-c20a-44fa-bcdb-599e7c015961 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:33.152105 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ee61cca9-c20a-44fa-bcdb-599e7c015961 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:33.152561 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ee61cca9-c20a-44fa-bcdb-599e7c015961 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:33.152985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ee61cca9-c20a-44fa-bcdb-599e7c015961 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:33.285514 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ee61cca9-c20a-44fa-bcdb-599e7c015961 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:33.294200 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ee61cca9-c20a-44fa-bcdb-599e7c015961 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.155504 Sep 13 03:24:33.294821 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 246/467] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:33 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:34.109225 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3ba43bdc-4db8-48a8-979a-80d1884e015b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:34.109858 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3ba43bdc-4db8-48a8-979a-80d1884e015b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:34.117268 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3ba43bdc-4db8-48a8-979a-80d1884e015b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:34.117752 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3ba43bdc-4db8-48a8-979a-80d1884e015b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:34.118184 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3ba43bdc-4db8-48a8-979a-80d1884e015b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:34.118895 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3ba43bdc-4db8-48a8-979a-80d1884e015b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:34.119347 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3ba43bdc-4db8-48a8-979a-80d1884e015b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:34.119765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3ba43bdc-4db8-48a8-979a-80d1884e015b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:34.253293 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3ba43bdc-4db8-48a8-979a-80d1884e015b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:34.262457 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3ba43bdc-4db8-48a8-979a-80d1884e015b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.156967 Sep 13 03:24:34.263295 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 222/468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:34 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:34.316018 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-bb7cd739-5628-45fd-97f4-d9462540cd56 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:34.316708 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-bb7cd739-5628-45fd-97f4-d9462540cd56 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:34.323629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bb7cd739-5628-45fd-97f4-d9462540cd56 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:34.324054 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bb7cd739-5628-45fd-97f4-d9462540cd56 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:34.324598 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bb7cd739-5628-45fd-97f4-d9462540cd56 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:34.325456 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bb7cd739-5628-45fd-97f4-d9462540cd56 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:34.325963 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bb7cd739-5628-45fd-97f4-d9462540cd56 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:34.326391 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bb7cd739-5628-45fd-97f4-d9462540cd56 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:34.369730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-be5ef36e-23ec-4f5c-a694-0ef2a54d6547 req-3c4b986f-f2c6-4f18-8f71-121982e6c257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad26b9d-e29a-4df3-b103-474a1c46c246", "name": "network-vif-plugged", "status": "completed", "tag": "abe9beab-d4f1-442b-aea1-34ae58f6c1e3"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:24:34.381226 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-be5ef36e-23ec-4f5c-a694-0ef2a54d6547 req-3c4b986f-f2c6-4f18-8f71-121982e6c257 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:34.381989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-be5ef36e-23ec-4f5c-a694-0ef2a54d6547 req-3c4b986f-f2c6-4f18-8f71-121982e6c257 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:34.382733 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-be5ef36e-23ec-4f5c-a694-0ef2a54d6547 req-3c4b986f-f2c6-4f18-8f71-121982e6c257 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:34.394347 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-be5ef36e-23ec-4f5c-a694-0ef2a54d6547 req-3c4b986f-f2c6-4f18-8f71-121982e6c257 service nova] Creating event network-vif-plugged:abe9beab-d4f1-442b-aea1-34ae58f6c1e3 for instance 9ad26b9d-e29a-4df3-b103-474a1c46c246 on hv-cinder-85707 Sep 13 03:24:34.399847 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-be5ef36e-23ec-4f5c-a694-0ef2a54d6547 req-3c4b986f-f2c6-4f18-8f71-121982e6c257 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034710 Sep 13 03:24:34.401041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 223/469] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:24:34.464658 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-bb7cd739-5628-45fd-97f4-d9462540cd56 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:34.472251 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-bb7cd739-5628-45fd-97f4-d9462540cd56 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.160075 Sep 13 03:24:34.472810 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 247/470] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:34 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:35.286012 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d1ef26e9-c0c8-4cd9-ab8f-1cb63eeb11d9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:35.286744 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d1ef26e9-c0c8-4cd9-ab8f-1cb63eeb11d9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:35.293228 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d1ef26e9-c0c8-4cd9-ab8f-1cb63eeb11d9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:35.293717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d1ef26e9-c0c8-4cd9-ab8f-1cb63eeb11d9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:35.294152 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d1ef26e9-c0c8-4cd9-ab8f-1cb63eeb11d9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:35.294874 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d1ef26e9-c0c8-4cd9-ab8f-1cb63eeb11d9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:35.295332 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d1ef26e9-c0c8-4cd9-ab8f-1cb63eeb11d9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:35.295758 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d1ef26e9-c0c8-4cd9-ab8f-1cb63eeb11d9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:35.429188 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d1ef26e9-c0c8-4cd9-ab8f-1cb63eeb11d9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:35.436898 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d1ef26e9-c0c8-4cd9-ab8f-1cb63eeb11d9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.155681 Sep 13 03:24:35.437458 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 224/471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:35 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:35.495726 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1c2d1f72-b0e2-4f08-b0ff-95e53956ff48 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:35.496331 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1c2d1f72-b0e2-4f08-b0ff-95e53956ff48 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:35.502202 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c2d1f72-b0e2-4f08-b0ff-95e53956ff48 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:35.502715 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c2d1f72-b0e2-4f08-b0ff-95e53956ff48 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:35.503146 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c2d1f72-b0e2-4f08-b0ff-95e53956ff48 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:35.503823 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c2d1f72-b0e2-4f08-b0ff-95e53956ff48 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:35.504271 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c2d1f72-b0e2-4f08-b0ff-95e53956ff48 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:35.504691 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c2d1f72-b0e2-4f08-b0ff-95e53956ff48 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:35.635206 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1c2d1f72-b0e2-4f08-b0ff-95e53956ff48 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:35.642911 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1c2d1f72-b0e2-4f08-b0ff-95e53956ff48 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.151904 Sep 13 03:24:35.643488 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 248/472] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:35 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:36.460545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4b33b8af-5de2-431a-b395-b9bfa3dbe043 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:36.461137 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-4b33b8af-5de2-431a-b395-b9bfa3dbe043 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:36.467487 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4b33b8af-5de2-431a-b395-b9bfa3dbe043 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:36.467971 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4b33b8af-5de2-431a-b395-b9bfa3dbe043 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:36.468400 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4b33b8af-5de2-431a-b395-b9bfa3dbe043 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:36.469081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4b33b8af-5de2-431a-b395-b9bfa3dbe043 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:36.469527 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4b33b8af-5de2-431a-b395-b9bfa3dbe043 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:36.469942 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4b33b8af-5de2-431a-b395-b9bfa3dbe043 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:36.599081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4b33b8af-5de2-431a-b395-b9bfa3dbe043 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:36.606718 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4b33b8af-5de2-431a-b395-b9bfa3dbe043 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.150651 Sep 13 03:24:36.607281 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 225/473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:36 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:36.665744 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4e62e7c2-cb10-43da-a92a-61f7427f0716 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:36.666354 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4e62e7c2-cb10-43da-a92a-61f7427f0716 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:36.672732 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4e62e7c2-cb10-43da-a92a-61f7427f0716 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:36.673224 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4e62e7c2-cb10-43da-a92a-61f7427f0716 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:36.673661 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4e62e7c2-cb10-43da-a92a-61f7427f0716 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:36.674358 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4e62e7c2-cb10-43da-a92a-61f7427f0716 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:36.674843 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4e62e7c2-cb10-43da-a92a-61f7427f0716 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:36.675268 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4e62e7c2-cb10-43da-a92a-61f7427f0716 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:36.801566 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4e62e7c2-cb10-43da-a92a-61f7427f0716 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:36.809862 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4e62e7c2-cb10-43da-a92a-61f7427f0716 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.147886 Sep 13 03:24:36.810443 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 249/474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:36 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:37.629073 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e17170ed-de1b-4eda-a457-f991af0d1e6f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:37.629794 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e17170ed-de1b-4eda-a457-f991af0d1e6f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:37.636800 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e17170ed-de1b-4eda-a457-f991af0d1e6f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:37.637305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e17170ed-de1b-4eda-a457-f991af0d1e6f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:37.637720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e17170ed-de1b-4eda-a457-f991af0d1e6f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:37.638410 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e17170ed-de1b-4eda-a457-f991af0d1e6f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:37.638883 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e17170ed-de1b-4eda-a457-f991af0d1e6f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:37.639306 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e17170ed-de1b-4eda-a457-f991af0d1e6f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:37.768093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-e17170ed-de1b-4eda-a457-f991af0d1e6f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:37.775792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e17170ed-de1b-4eda-a457-f991af0d1e6f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.150555 Sep 13 03:24:37.776354 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 226/475] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:37 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:37.834561 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-15499716-d56f-4592-a095-aa36d7c9448e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:37.835199 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-15499716-d56f-4592-a095-aa36d7c9448e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:37.841133 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-15499716-d56f-4592-a095-aa36d7c9448e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:37.841624 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-15499716-d56f-4592-a095-aa36d7c9448e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:37.842055 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-15499716-d56f-4592-a095-aa36d7c9448e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:37.842784 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-15499716-d56f-4592-a095-aa36d7c9448e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:37.843236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-15499716-d56f-4592-a095-aa36d7c9448e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:37.843658 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-15499716-d56f-4592-a095-aa36d7c9448e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:37.975466 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-15499716-d56f-4592-a095-aa36d7c9448e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:37.983127 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-15499716-d56f-4592-a095-aa36d7c9448e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.152465 Sep 13 03:24:37.983689 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 250/476] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:37 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:38.798298 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a9f43a77-4795-4a51-b60e-ca24f10fb2f4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:38.798862 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a9f43a77-4795-4a51-b60e-ca24f10fb2f4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:38.805443 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a9f43a77-4795-4a51-b60e-ca24f10fb2f4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:38.805939 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a9f43a77-4795-4a51-b60e-ca24f10fb2f4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:38.806375 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a9f43a77-4795-4a51-b60e-ca24f10fb2f4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:38.807107 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a9f43a77-4795-4a51-b60e-ca24f10fb2f4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:38.807567 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a9f43a77-4795-4a51-b60e-ca24f10fb2f4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:38.807993 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a9f43a77-4795-4a51-b60e-ca24f10fb2f4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:38.943039 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a9f43a77-4795-4a51-b60e-ca24f10fb2f4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:38.951333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a9f43a77-4795-4a51-b60e-ca24f10fb2f4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.156942 Sep 13 03:24:38.951912 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 227/477] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:38 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:39.006819 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-383ab6c5-56ea-44cd-bafa-ce69ec5b5332 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:39.007423 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-383ab6c5-56ea-44cd-bafa-ce69ec5b5332 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:39.009366 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=80 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:39.014520 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-383ab6c5-56ea-44cd-bafa-ce69ec5b5332 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:39.015039 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-383ab6c5-56ea-44cd-bafa-ce69ec5b5332 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:39.015472 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-383ab6c5-56ea-44cd-bafa-ce69ec5b5332 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:39.016155 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-383ab6c5-56ea-44cd-bafa-ce69ec5b5332 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:39.016606 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-383ab6c5-56ea-44cd-bafa-ce69ec5b5332 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:39.017024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-383ab6c5-56ea-44cd-bafa-ce69ec5b5332 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:39.150953 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-383ab6c5-56ea-44cd-bafa-ce69ec5b5332 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:39.158599 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-383ab6c5-56ea-44cd-bafa-ce69ec5b5332 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.156083 Sep 13 03:24:39.159190 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 251/478] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:39 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:39.975617 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2b3cc6c2-a9c4-48a4-9771-52f2d73619c4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:39.976234 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2b3cc6c2-a9c4-48a4-9771-52f2d73619c4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:39.982687 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2b3cc6c2-a9c4-48a4-9771-52f2d73619c4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:39.983180 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2b3cc6c2-a9c4-48a4-9771-52f2d73619c4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:39.983618 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2b3cc6c2-a9c4-48a4-9771-52f2d73619c4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:39.984309 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2b3cc6c2-a9c4-48a4-9771-52f2d73619c4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:39.984776 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2b3cc6c2-a9c4-48a4-9771-52f2d73619c4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:39.985201 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2b3cc6c2-a9c4-48a4-9771-52f2d73619c4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:40.116461 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2b3cc6c2-a9c4-48a4-9771-52f2d73619c4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:40.124197 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2b3cc6c2-a9c4-48a4-9771-52f2d73619c4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.153061 Sep 13 03:24:40.124763 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 228/479] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:39 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:40.181228 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-095f73ba-8d3a-4395-a9be-7b2270e7c241 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:40.181859 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-095f73ba-8d3a-4395-a9be-7b2270e7c241 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:40.187776 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-095f73ba-8d3a-4395-a9be-7b2270e7c241 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:40.188264 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-095f73ba-8d3a-4395-a9be-7b2270e7c241 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:40.188700 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-095f73ba-8d3a-4395-a9be-7b2270e7c241 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:40.189388 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-095f73ba-8d3a-4395-a9be-7b2270e7c241 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:40.189845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-095f73ba-8d3a-4395-a9be-7b2270e7c241 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:40.190271 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-095f73ba-8d3a-4395-a9be-7b2270e7c241 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:40.318123 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-095f73ba-8d3a-4395-a9be-7b2270e7c241 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:40.326275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-095f73ba-8d3a-4395-a9be-7b2270e7c241 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1319 microversion: 2.1 time: 0.148883 Sep 13 03:24:40.326881 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 252/480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:40 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:41.146636 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2b259dc5-fa05-4dea-a7df-d3ef23c4bfa1 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:41.147831 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2b259dc5-fa05-4dea-a7df-d3ef23c4bfa1 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:41.154204 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2b259dc5-fa05-4dea-a7df-d3ef23c4bfa1 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:41.154729 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2b259dc5-fa05-4dea-a7df-d3ef23c4bfa1 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:41.155163 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2b259dc5-fa05-4dea-a7df-d3ef23c4bfa1 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:41.155854 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2b259dc5-fa05-4dea-a7df-d3ef23c4bfa1 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:41.156301 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2b259dc5-fa05-4dea-a7df-d3ef23c4bfa1 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:41.156717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2b259dc5-fa05-4dea-a7df-d3ef23c4bfa1 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:41.290502 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2b259dc5-fa05-4dea-a7df-d3ef23c4bfa1 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:41.298442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2b259dc5-fa05-4dea-a7df-d3ef23c4bfa1 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.155631 Sep 13 03:24:41.299044 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 229/481] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:41 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:41.349324 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-32014d86-d80c-450a-827f-ade2338b3100 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:41.349909 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-32014d86-d80c-450a-827f-ade2338b3100 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:41.355926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-32014d86-d80c-450a-827f-ade2338b3100 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:41.356417 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-32014d86-d80c-450a-827f-ade2338b3100 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:41.356850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-32014d86-d80c-450a-827f-ade2338b3100 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:41.357541 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-32014d86-d80c-450a-827f-ade2338b3100 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:41.357996 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-32014d86-d80c-450a-827f-ade2338b3100 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:41.358420 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-32014d86-d80c-450a-827f-ade2338b3100 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:41.488800 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-32014d86-d80c-450a-827f-ade2338b3100 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:41.497043 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-32014d86-d80c-450a-827f-ade2338b3100 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1508 microversion: 2.1 time: 0.151637 Sep 13 03:24:41.497606 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 253/482] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:41 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:24:41.521370 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3d9453bd-092d-4ca4-a8d1-7dfc4658fbfb tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d877ac61-c89f-4360-8380-83e7ea12df27", "device": "/dev/sdb"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:24:41.523776 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3d9453bd-092d-4ca4-a8d1-7dfc4658fbfb tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:41.529636 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d9453bd-092d-4ca4-a8d1-7dfc4658fbfb tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:41.530139 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d9453bd-092d-4ca4-a8d1-7dfc4658fbfb tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:41.530551 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d9453bd-092d-4ca4-a8d1-7dfc4658fbfb tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:41.531253 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d9453bd-092d-4ca4-a8d1-7dfc4658fbfb tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:41.531702 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d9453bd-092d-4ca4-a8d1-7dfc4658fbfb tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:41.532118 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3d9453bd-092d-4ca4-a8d1-7dfc4658fbfb tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:42.321783 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-279ae9fd-3308-4065-990d-dbab31e62b21 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:42.322444 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-279ae9fd-3308-4065-990d-dbab31e62b21 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:42.328295 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-279ae9fd-3308-4065-990d-dbab31e62b21 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:42.328785 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-279ae9fd-3308-4065-990d-dbab31e62b21 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:42.329224 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-279ae9fd-3308-4065-990d-dbab31e62b21 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:42.329904 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-279ae9fd-3308-4065-990d-dbab31e62b21 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:42.330357 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-279ae9fd-3308-4065-990d-dbab31e62b21 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:42.330807 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-279ae9fd-3308-4065-990d-dbab31e62b21 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:42.334628 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:42.463128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-279ae9fd-3308-4065-990d-dbab31e62b21 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:42.470744 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-279ae9fd-3308-4065-990d-dbab31e62b21 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.153338 Sep 13 03:24:42.471309 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 254/483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:42 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:24:43.083281 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3d9453bd-092d-4ca4-a8d1-7dfc4658fbfb tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "POST /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.565602 Sep 13 03:24:43.084081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 230/484] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:24:41 2022] POST /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246/os-volume_attachments => generated 194 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:24:43.295879 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-6ee1a51d-22f2-41f4-abdb-04ef1989c0bf req-0c5b02dd-26eb-48c9-8cc8-e5b51c78bfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae88f2e-fe4e-46c6-bf5a-0381e90e26c6", "name": "network-vif-plugged", "status": "completed", "tag": "802c0f2a-3726-4731-b295-4046e1e4707e"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:24:43.306983 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6ee1a51d-22f2-41f4-abdb-04ef1989c0bf req-0c5b02dd-26eb-48c9-8cc8-e5b51c78bfd5 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:43.307475 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6ee1a51d-22f2-41f4-abdb-04ef1989c0bf req-0c5b02dd-26eb-48c9-8cc8-e5b51c78bfd5 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:43.308671 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6ee1a51d-22f2-41f4-abdb-04ef1989c0bf req-0c5b02dd-26eb-48c9-8cc8-e5b51c78bfd5 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:43.320967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-6ee1a51d-22f2-41f4-abdb-04ef1989c0bf req-0c5b02dd-26eb-48c9-8cc8-e5b51c78bfd5 service nova] Creating event network-vif-plugged:802c0f2a-3726-4731-b295-4046e1e4707e for instance aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 on hv-cinder-85707 Sep 13 03:24:43.326013 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-6ee1a51d-22f2-41f4-abdb-04ef1989c0bf req-0c5b02dd-26eb-48c9-8cc8-e5b51c78bfd5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034073 Sep 13 03:24:43.326630 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 255/485] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:24:43.493839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-792c509f-f403-45f3-964f-858f550dd7ca tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:43.494757 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-792c509f-f403-45f3-964f-858f550dd7ca tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:43.501453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-792c509f-f403-45f3-964f-858f550dd7ca tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:43.501945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-792c509f-f403-45f3-964f-858f550dd7ca tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:43.502429 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-792c509f-f403-45f3-964f-858f550dd7ca tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:43.503110 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-792c509f-f403-45f3-964f-858f550dd7ca tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:43.503567 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-792c509f-f403-45f3-964f-858f550dd7ca tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:43.503987 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-792c509f-f403-45f3-964f-858f550dd7ca tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:43.636319 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-792c509f-f403-45f3-964f-858f550dd7ca tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:43.644005 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-792c509f-f403-45f3-964f-858f550dd7ca tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.154405 Sep 13 03:24:43.644574 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 231/486] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:43 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:24:44.667348 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ba6eea01-bcfb-4e51-937f-7ed1c6dd2896 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:44.668314 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ba6eea01-bcfb-4e51-937f-7ed1c6dd2896 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:44.674318 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba6eea01-bcfb-4e51-937f-7ed1c6dd2896 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:44.674839 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba6eea01-bcfb-4e51-937f-7ed1c6dd2896 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:44.675278 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba6eea01-bcfb-4e51-937f-7ed1c6dd2896 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:44.675964 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba6eea01-bcfb-4e51-937f-7ed1c6dd2896 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:44.676965 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba6eea01-bcfb-4e51-937f-7ed1c6dd2896 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:44.677398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba6eea01-bcfb-4e51-937f-7ed1c6dd2896 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:44.811990 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ba6eea01-bcfb-4e51-937f-7ed1c6dd2896 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:44.820732 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ba6eea01-bcfb-4e51-937f-7ed1c6dd2896 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.158369 Sep 13 03:24:44.826312 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 256/487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:44 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:45.843694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0c0b7bbf-9686-46d9-8359-24b40bbcc7e7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:45.844334 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0c0b7bbf-9686-46d9-8359-24b40bbcc7e7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:45.850789 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c0b7bbf-9686-46d9-8359-24b40bbcc7e7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:45.851277 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c0b7bbf-9686-46d9-8359-24b40bbcc7e7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:45.851710 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c0b7bbf-9686-46d9-8359-24b40bbcc7e7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:45.852397 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c0b7bbf-9686-46d9-8359-24b40bbcc7e7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:45.852847 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c0b7bbf-9686-46d9-8359-24b40bbcc7e7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:45.853266 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c0b7bbf-9686-46d9-8359-24b40bbcc7e7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:45.990009 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0c0b7bbf-9686-46d9-8359-24b40bbcc7e7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:45.998207 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0c0b7bbf-9686-46d9-8359-24b40bbcc7e7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1260 microversion: 2.1 time: 0.158171 Sep 13 03:24:45.998528 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 232/488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:45 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:47.021325 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-61d17871-0f5e-4916-81c4-8146bbb0a18f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:47.022576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-61d17871-0f5e-4916-81c4-8146bbb0a18f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:47.028585 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-61d17871-0f5e-4916-81c4-8146bbb0a18f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:47.029063 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-61d17871-0f5e-4916-81c4-8146bbb0a18f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:47.029518 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-61d17871-0f5e-4916-81c4-8146bbb0a18f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:47.030194 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-61d17871-0f5e-4916-81c4-8146bbb0a18f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:47.030665 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-61d17871-0f5e-4916-81c4-8146bbb0a18f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:47.031086 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-61d17871-0f5e-4916-81c4-8146bbb0a18f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:47.164370 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-61d17871-0f5e-4916-81c4-8146bbb0a18f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:47.172695 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-61d17871-0f5e-4916-81c4-8146bbb0a18f tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1443 microversion: 2.1 time: 0.155141 Sep 13 03:24:47.187004 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 257/489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:47 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1443 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:47.196230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-cbc9d220-4f3c-4528-a3da-859a48f03df7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:24:47.196991 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-cbc9d220-4f3c-4528-a3da-859a48f03df7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:24:47.204496 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cbc9d220-4f3c-4528-a3da-859a48f03df7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:47.205645 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cbc9d220-4f3c-4528-a3da-859a48f03df7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:47.206333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cbc9d220-4f3c-4528-a3da-859a48f03df7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:47.207923 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cbc9d220-4f3c-4528-a3da-859a48f03df7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:47.210768 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cbc9d220-4f3c-4528-a3da-859a48f03df7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:47.211395 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cbc9d220-4f3c-4528-a3da-859a48f03df7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:47.341528 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-cbc9d220-4f3c-4528-a3da-859a48f03df7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:24:47.349324 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-cbc9d220-4f3c-4528-a3da-859a48f03df7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1443 microversion: 2.1 time: 0.158053 Sep 13 03:24:47.349933 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 233/490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:24:47 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:24:49.282944 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-5951ea87-a641-4eed-b7db-23ee589946cf req-fda45a6d-45e5-4464-bb3e-3fe6de51fb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae88f2e-fe4e-46c6-bf5a-0381e90e26c6", "tag": "802c0f2a-3726-4731-b295-4046e1e4707e"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:24:49.292224 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-5951ea87-a641-4eed-b7db-23ee589946cf req-fda45a6d-45e5-4464-bb3e-3fe6de51fb2e service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:24:49.292969 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-5951ea87-a641-4eed-b7db-23ee589946cf req-fda45a6d-45e5-4464-bb3e-3fe6de51fb2e service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:24:49.293400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-5951ea87-a641-4eed-b7db-23ee589946cf req-fda45a6d-45e5-4464-bb3e-3fe6de51fb2e service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:24:49.304612 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-5951ea87-a641-4eed-b7db-23ee589946cf req-fda45a6d-45e5-4464-bb3e-3fe6de51fb2e service nova] Creating event network-changed:802c0f2a-3726-4731-b295-4046e1e4707e for instance aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 on hv-cinder-85707 Sep 13 03:24:49.309644 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-5951ea87-a641-4eed-b7db-23ee589946cf req-fda45a6d-45e5-4464-bb3e-3fe6de51fb2e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030528 Sep 13 03:24:49.310238 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 258/491] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:25:09.717613 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7cbda23f-f276-4df9-9c3e-8db986ac1762 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:09.718128 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7cbda23f-f276-4df9-9c3e-8db986ac1762 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:09.720764 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=33 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:25:09.721572 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:25:09.727845 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7cbda23f-f276-4df9-9c3e-8db986ac1762 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:09.728328 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7cbda23f-f276-4df9-9c3e-8db986ac1762 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:09.728759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7cbda23f-f276-4df9-9c3e-8db986ac1762 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:09.729446 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7cbda23f-f276-4df9-9c3e-8db986ac1762 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:09.729894 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7cbda23f-f276-4df9-9c3e-8db986ac1762 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:09.730311 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7cbda23f-f276-4df9-9c3e-8db986ac1762 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:09.809760 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-7cbda23f-f276-4df9-9c3e-8db986ac1762 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lazy-loading 'services' on Instance uuid 9ad26b9d-e29a-4df3-b103-474a1c46c246 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:25:09.879686 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7cbda23f-f276-4df9-9c3e-8db986ac1762 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246/os-volume_attachments/d877ac61-c89f-4360-8380-83e7ea12df27" status: 202 len: 0 microversion: 2.1 time: 0.165870 Sep 13 03:25:09.880266 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 234/492] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 03:25:09 2022] DELETE /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246/os-volume_attachments/d877ac61-c89f-4360-8380-83e7ea12df27 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:25:12.055298 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=15 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:25:12.056031 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=21 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:25:12.060652 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cf54a658-efb5-4f2d-b135-92541c2ac8ae tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:12.061266 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-cf54a658-efb5-4f2d-b135-92541c2ac8ae tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:12.068479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf54a658-efb5-4f2d-b135-92541c2ac8ae tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:12.069098 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf54a658-efb5-4f2d-b135-92541c2ac8ae tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:12.069535 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf54a658-efb5-4f2d-b135-92541c2ac8ae tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:12.070231 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf54a658-efb5-4f2d-b135-92541c2ac8ae tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:12.070831 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf54a658-efb5-4f2d-b135-92541c2ac8ae tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:12.071385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf54a658-efb5-4f2d-b135-92541c2ac8ae tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:12.096137 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-cf54a658-efb5-4f2d-b135-92541c2ac8ae tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Going to try to terminate instance {{(pid=120383) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:25:12.177013 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-cf54a658-efb5-4f2d-b135-92541c2ac8ae tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 204 len: 0 microversion: 2.1 time: 0.122686 Sep 13 03:25:12.177583 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 259/493] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:25:12 2022] DELETE /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:25:12.186576 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8d754ef1-39b2-47db-ac69-3a026bae5f5e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:12.187302 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8d754ef1-39b2-47db-ac69-3a026bae5f5e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:12.193307 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8d754ef1-39b2-47db-ac69-3a026bae5f5e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:12.193788 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8d754ef1-39b2-47db-ac69-3a026bae5f5e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:12.194221 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8d754ef1-39b2-47db-ac69-3a026bae5f5e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:12.194942 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8d754ef1-39b2-47db-ac69-3a026bae5f5e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:12.195397 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8d754ef1-39b2-47db-ac69-3a026bae5f5e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:12.195820 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8d754ef1-39b2-47db-ac69-3a026bae5f5e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:12.325813 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-8d754ef1-39b2-47db-ac69-3a026bae5f5e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:12.333479 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8d754ef1-39b2-47db-ac69-3a026bae5f5e tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1514 microversion: 2.1 time: 0.151501 Sep 13 03:25:12.334050 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 235/494] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:12 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:25:13.357668 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-12360d0c-d86a-4858-83cf-2a92385a5023 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:13.358294 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-12360d0c-d86a-4858-83cf-2a92385a5023 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:13.364172 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-12360d0c-d86a-4858-83cf-2a92385a5023 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:13.364657 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-12360d0c-d86a-4858-83cf-2a92385a5023 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:13.365095 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-12360d0c-d86a-4858-83cf-2a92385a5023 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:13.365783 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-12360d0c-d86a-4858-83cf-2a92385a5023 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:13.366296 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-12360d0c-d86a-4858-83cf-2a92385a5023 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:13.366781 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-12360d0c-d86a-4858-83cf-2a92385a5023 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:13.493667 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-12360d0c-d86a-4858-83cf-2a92385a5023 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:13.501321 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-12360d0c-d86a-4858-83cf-2a92385a5023 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1514 microversion: 2.1 time: 0.148451 Sep 13 03:25:13.501883 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 260/495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:13 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:14.524295 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8a996e8d-5932-4bf1-84d5-77074fd90b9f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:14.524940 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8a996e8d-5932-4bf1-84d5-77074fd90b9f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:14.531352 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8a996e8d-5932-4bf1-84d5-77074fd90b9f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:14.531843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8a996e8d-5932-4bf1-84d5-77074fd90b9f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:14.532280 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8a996e8d-5932-4bf1-84d5-77074fd90b9f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:14.532971 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8a996e8d-5932-4bf1-84d5-77074fd90b9f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:14.533427 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8a996e8d-5932-4bf1-84d5-77074fd90b9f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:14.533854 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8a996e8d-5932-4bf1-84d5-77074fd90b9f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:14.659641 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-8a996e8d-5932-4bf1-84d5-77074fd90b9f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:14.667964 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8a996e8d-5932-4bf1-84d5-77074fd90b9f tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1514 microversion: 2.1 time: 0.147542 Sep 13 03:25:14.668533 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 236/496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:14 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:15.507688 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-42192da3-d7ca-4ab0-8f4c-f1ff55411b09 req-90c4ea01-ec9c-4d69-a24c-2aafb094e86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad26b9d-e29a-4df3-b103-474a1c46c246", "name": "network-vif-deleted", "tag": "abe9beab-d4f1-442b-aea1-34ae58f6c1e3"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:25:15.517606 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-42192da3-d7ca-4ab0-8f4c-f1ff55411b09 req-90c4ea01-ec9c-4d69-a24c-2aafb094e86c service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:15.518081 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-42192da3-d7ca-4ab0-8f4c-f1ff55411b09 req-90c4ea01-ec9c-4d69-a24c-2aafb094e86c service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:15.518503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-42192da3-d7ca-4ab0-8f4c-f1ff55411b09 req-90c4ea01-ec9c-4d69-a24c-2aafb094e86c service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:15.529501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-42192da3-d7ca-4ab0-8f4c-f1ff55411b09 req-90c4ea01-ec9c-4d69-a24c-2aafb094e86c service nova] Creating event network-vif-deleted:abe9beab-d4f1-442b-aea1-34ae58f6c1e3 for instance 9ad26b9d-e29a-4df3-b103-474a1c46c246 on hv-cinder-85707 Sep 13 03:25:15.534292 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-42192da3-d7ca-4ab0-8f4c-f1ff55411b09 req-90c4ea01-ec9c-4d69-a24c-2aafb094e86c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030272 Sep 13 03:25:15.534980 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 261/497] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:25:15.691671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:15.692402 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:15.699540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:15.700030 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:15.700466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:15.701227 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:15.701661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:15.702034 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:15.733404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:15.733888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:15.734311 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:15.734784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lazy-loading 'fault' on Instance uuid 9ad26b9d-e29a-4df3-b103-474a1c46c246 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:25:15.780264 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:15.787890 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-49fd1751-bb84-4c8e-af1c-9d8db8c801e3 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1309 microversion: 2.1 time: 0.100142 Sep 13 03:25:15.788481 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 237/498] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:15 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:16.811804 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:16.812506 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:16.818869 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:16.819447 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:16.819989 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:16.820754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:16.821715 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:16.822146 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:16.852844 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:16.853320 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:16.853752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:16.854189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lazy-loading 'fault' on Instance uuid 9ad26b9d-e29a-4df3-b103-474a1c46c246 {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:25:16.896960 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:16.904977 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-77bfae5b-5d0c-4afe-aa8e-e0840dfd518c tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1309 microversion: 2.1 time: 0.097363 Sep 13 03:25:16.905537 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 262/499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:16 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:17.927574 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:17.928163 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:17.935084 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:17.935562 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:17.935989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:17.936668 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:17.937114 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:17.937533 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:17.967210 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:17.967680 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:17.968110 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:17.968546 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lazy-loading 'fault' on Instance uuid 9ad26b9d-e29a-4df3-b103-474a1c46c246 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:25:18.010645 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:18.018085 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-728edd19-53d0-484e-b117-b5bba41a8022 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1309 microversion: 2.1 time: 0.094325 Sep 13 03:25:18.018659 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 238/500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:17 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:19.041484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:19.042348 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:19.048302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:19.048786 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:19.049285 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:19.049972 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:19.050417 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:19.050871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:19.083194 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:19.083606 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:19.084034 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:19.084482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lazy-loading 'fault' on Instance uuid 9ad26b9d-e29a-4df3-b103-474a1c46c246 {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:25:19.124147 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '466f990dcac84f4faec701b28616273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ef3a6638114e1f9c838b00285f43f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:19.131553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-425f76ca-71ca-4020-891d-5d8493b5fe53 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 200 len: 1309 microversion: 2.1 time: 0.094493 Sep 13 03:25:19.132102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 263/501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:19 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:20.154906 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ba175a26-3292-475d-bc13-96658a223f55 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:20.155420 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ba175a26-3292-475d-bc13-96658a223f55 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] [instance: 9ad26b9d-e29a-4df3-b103-474a1c46c246] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:20.161816 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba175a26-3292-475d-bc13-96658a223f55 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:20.162295 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba175a26-3292-475d-bc13-96658a223f55 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:20.162772 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba175a26-3292-475d-bc13-96658a223f55 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:20.163452 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba175a26-3292-475d-bc13-96658a223f55 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:20.163902 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba175a26-3292-475d-bc13-96658a223f55 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:20.164319 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba175a26-3292-475d-bc13-96658a223f55 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:20.179703 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-ba175a26-3292-475d-bc13-96658a223f55 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] HTTP exception thrown: Instance 9ad26b9d-e29a-4df3-b103-474a1c46c246 could not be found. Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ba175a26-3292-475d-bc13-96658a223f55 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Request method failure captured: Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 HTTP/1.1 Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_c4vCoAaeLkPSLhNibktjPn3EflmBX9BIaKuX5nuBmx4F-vsOZgZSxI3kzD-47SUevVPrDu1GgfcnY3x753y6G0w1UGAsOOE_7int_q0TI12QSGOAwOi93rPABiEH8scJfAdwrCVKdskJtKc9po6WqEZyUrlemSvnksgdE9PSEZBxU Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: b3ef3a6638114e1f9c838b00285f43f6 Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-VolumesSnapshotTestJSON-900372526 Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:25:20.182540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:25:20.184097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b3ef3a6638114e1f9c838b00285f43f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b3ef3a6638114e1f9c838b00285f43f6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3ef3a6638114e1f9c838b00285f43f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3ef3a6638114e1f9c838b00285f43f6"}]}] Sep 13 03:25:20.184097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-VolumesSnapshotTestJSON-900372526 Sep 13 03:25:20.184097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: b3ef3a6638114e1f9c838b00285f43f6 Sep 13 03:25:20.184097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-900372526 Sep 13 03:25:20.184097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-VolumesSnapshotTestJSON-900372526-project Sep 13 03:25:20.184097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:25:20.184097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:25:20.184097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 466f990dcac84f4faec701b28616273e Sep 13 03:25:20.184097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-VolumesSnapshotTestJSON-900372526-project Sep 13 03:25:20.184097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:25:20.184097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance 9ad26b9d-e29a-4df3-b103-474a1c46c246 could not be found. Sep 13 03:25:20.184097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': '9ad26b9d-e29a-4df3-b103-474a1c46c246'} Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad26b9d-e29a-4df3-b103-474a1c46c246 could not be found. Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:25:20.184872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad26b9d-e29a-4df3-b103-474a1c46c246 could not be found. Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad26b9d-e29a-4df3-b103-474a1c46c246 could not be found. Sep 13 03:25:20.186241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:25:20.188055 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ba175a26-3292-475d-bc13-96658a223f55 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] Returning 404 to user: Instance 9ad26b9d-e29a-4df3-b103-474a1c46c246 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:25:20.188055 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ba175a26-3292-475d-bc13-96658a223f55 tempest-VolumesSnapshotTestJSON-900372526 tempest-VolumesSnapshotTestJSON-900372526-project] 10.222.0.18 "GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246" status: 404 len: 111 microversion: 2.1 time: 0.033160 Sep 13 03:25:20.188055 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 239/502] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:20 2022] GET /compute/v2.1/servers/9ad26b9d-e29a-4df3-b103-474a1c46c246 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 03:25:24.561199 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-055603b2-c522-4015-b77a-ac9f6b80ba6a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:25:24.563362 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-055603b2-c522-4015-b77a-ac9f6b80ba6a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:24.569428 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-055603b2-c522-4015-b77a-ac9f6b80ba6a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:24.569917 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-055603b2-c522-4015-b77a-ac9f6b80ba6a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:24.570355 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-055603b2-c522-4015-b77a-ac9f6b80ba6a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:24.571074 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-055603b2-c522-4015-b77a-ac9f6b80ba6a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:24.571533 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-055603b2-c522-4015-b77a-ac9f6b80ba6a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:24.571959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-055603b2-c522-4015-b77a-ac9f6b80ba6a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:26.140454 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-055603b2-c522-4015-b77a-ac9f6b80ba6a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "POST /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/action" status: 200 len: 37901 microversion: 2.1 time: 1.582854 Sep 13 03:25:26.141180 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 264/503] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:25:24 2022] POST /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/action => generated 37901 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:25:26.288781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b61aaf6f-a08e-4d40-a79c-ba5b2cbc62f8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:26.289341 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b61aaf6f-a08e-4d40-a79c-ba5b2cbc62f8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:26.296655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b61aaf6f-a08e-4d40-a79c-ba5b2cbc62f8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:26.297139 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b61aaf6f-a08e-4d40-a79c-ba5b2cbc62f8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:26.297574 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b61aaf6f-a08e-4d40-a79c-ba5b2cbc62f8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:26.298259 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b61aaf6f-a08e-4d40-a79c-ba5b2cbc62f8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:26.298739 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b61aaf6f-a08e-4d40-a79c-ba5b2cbc62f8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:26.299163 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b61aaf6f-a08e-4d40-a79c-ba5b2cbc62f8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:26.321646 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b61aaf6f-a08e-4d40-a79c-ba5b2cbc62f8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/ips" status: 200 len: 145 microversion: 2.1 time: 0.036628 Sep 13 03:25:26.322130 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 240/504] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 03:25:26 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:25:30.421133 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0e8d0ac7-7a5c-46be-8f9c-8ca2ef902865 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10a991dc-6fc1-4cde-926b-db43ec74f3d7"}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:25:30.423678 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0e8d0ac7-7a5c-46be-8f9c-8ca2ef902865 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:30.431298 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0e8d0ac7-7a5c-46be-8f9c-8ca2ef902865 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:30.431776 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0e8d0ac7-7a5c-46be-8f9c-8ca2ef902865 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:30.432231 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0e8d0ac7-7a5c-46be-8f9c-8ca2ef902865 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:30.432902 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0e8d0ac7-7a5c-46be-8f9c-8ca2ef902865 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:30.433349 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0e8d0ac7-7a5c-46be-8f9c-8ca2ef902865 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:30.433761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0e8d0ac7-7a5c-46be-8f9c-8ca2ef902865 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:30.801557 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0e8d0ac7-7a5c-46be-8f9c-8ca2ef902865 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "POST /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384818 Sep 13 03:25:30.807561 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 265/505] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:25:30 2022] POST /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:25:41.535048 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9a064f23-1b51-4b55-a12f-ea1a948f373a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:25:41.537224 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=18 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:25:41.537862 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:25:41.544134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9a064f23-1b51-4b55-a12f-ea1a948f373a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:41.544634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9a064f23-1b51-4b55-a12f-ea1a948f373a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:41.545073 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9a064f23-1b51-4b55-a12f-ea1a948f373a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:41.607151 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9a064f23-1b51-4b55-a12f-ea1a948f373a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Going to try to stop instance {{(pid=120384) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 03:25:41.675732 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9a064f23-1b51-4b55-a12f-ea1a948f373a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "POST /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/action" status: 202 len: 0 microversion: 2.1 time: 0.144400 Sep 13 03:25:41.676666 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 241/506] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:25:41 2022] POST /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:25:41.684664 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:25:41.688034 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:25:41.693358 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-78877262-12e9-4649-b37e-7f4a07a47fc7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:41.694317 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-78877262-12e9-4649-b37e-7f4a07a47fc7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:41.702947 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-78877262-12e9-4649-b37e-7f4a07a47fc7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:41.703746 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-78877262-12e9-4649-b37e-7f4a07a47fc7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:41.704258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-78877262-12e9-4649-b37e-7f4a07a47fc7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:41.704977 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-78877262-12e9-4649-b37e-7f4a07a47fc7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:41.705435 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-78877262-12e9-4649-b37e-7f4a07a47fc7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:41.705865 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-78877262-12e9-4649-b37e-7f4a07a47fc7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:41.815763 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ba4fcea9-91fd-4a13-b0bf-edfd94e813c5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:25:41.818194 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ba4fcea9-91fd-4a13-b0bf-edfd94e813c5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:41.824904 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba4fcea9-91fd-4a13-b0bf-edfd94e813c5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:41.825401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba4fcea9-91fd-4a13-b0bf-edfd94e813c5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:41.825842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba4fcea9-91fd-4a13-b0bf-edfd94e813c5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:41.826542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba4fcea9-91fd-4a13-b0bf-edfd94e813c5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:41.827027 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba4fcea9-91fd-4a13-b0bf-edfd94e813c5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:41.827452 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba4fcea9-91fd-4a13-b0bf-edfd94e813c5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:41.840198 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-78877262-12e9-4649-b37e-7f4a07a47fc7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:41.849443 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-78877262-12e9-4649-b37e-7f4a07a47fc7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1723 microversion: 2.1 time: 0.167288 Sep 13 03:25:41.850148 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 266/507] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:41 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:41.953415 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ba4fcea9-91fd-4a13-b0bf-edfd94e813c5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "POST /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/action" status: 200 len: 28635 microversion: 2.20 time: 0.141765 Sep 13 03:25:41.955201 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 242/508] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Sep 13 03:25:41 2022] POST /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/action => generated 28635 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:25:42.369901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cc1e6121-8f69-4209-b8ee-3e0cf67af5a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:25:42.372304 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-cc1e6121-8f69-4209-b8ee-3e0cf67af5a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:42.378653 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cc1e6121-8f69-4209-b8ee-3e0cf67af5a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:42.379509 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cc1e6121-8f69-4209-b8ee-3e0cf67af5a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:42.379948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cc1e6121-8f69-4209-b8ee-3e0cf67af5a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:42.380645 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cc1e6121-8f69-4209-b8ee-3e0cf67af5a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:42.381099 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cc1e6121-8f69-4209-b8ee-3e0cf67af5a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:42.381526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cc1e6121-8f69-4209-b8ee-3e0cf67af5a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:42.522109 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-cc1e6121-8f69-4209-b8ee-3e0cf67af5a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/action" status: 200 len: 28640 microversion: 2.1 time: 0.155835 Sep 13 03:25:42.522731 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 267/509] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:25:42 2022] POST /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/action => generated 28640 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:25:42.874627 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-504853a1-2872-4210-bd24-246714b950e9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:42.875550 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-504853a1-2872-4210-bd24-246714b950e9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:42.882812 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-504853a1-2872-4210-bd24-246714b950e9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:42.883306 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-504853a1-2872-4210-bd24-246714b950e9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:42.883736 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-504853a1-2872-4210-bd24-246714b950e9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:42.885146 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-504853a1-2872-4210-bd24-246714b950e9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:42.885599 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-504853a1-2872-4210-bd24-246714b950e9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:42.886017 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-504853a1-2872-4210-bd24-246714b950e9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:43.017067 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-504853a1-2872-4210-bd24-246714b950e9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:43.025789 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-504853a1-2872-4210-bd24-246714b950e9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1723 microversion: 2.1 time: 0.155769 Sep 13 03:25:43.026347 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 243/510] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:42 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:44.049621 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ee152ed0-116c-4434-98fe-5d236b3c2514 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:44.050344 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ee152ed0-116c-4434-98fe-5d236b3c2514 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:44.057093 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ee152ed0-116c-4434-98fe-5d236b3c2514 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:44.057575 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ee152ed0-116c-4434-98fe-5d236b3c2514 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:44.058005 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ee152ed0-116c-4434-98fe-5d236b3c2514 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:44.058705 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ee152ed0-116c-4434-98fe-5d236b3c2514 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:44.059159 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ee152ed0-116c-4434-98fe-5d236b3c2514 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:44.059604 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ee152ed0-116c-4434-98fe-5d236b3c2514 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:44.192925 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ee152ed0-116c-4434-98fe-5d236b3c2514 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:44.202030 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ee152ed0-116c-4434-98fe-5d236b3c2514 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1723 microversion: 2.1 time: 0.156707 Sep 13 03:25:44.202591 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 268/511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:44 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:45.224572 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-61ffe36d-9c02-4652-8855-a6ef7ae15de9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:45.225175 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-61ffe36d-9c02-4652-8855-a6ef7ae15de9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:45.232148 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-61ffe36d-9c02-4652-8855-a6ef7ae15de9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:45.232628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-61ffe36d-9c02-4652-8855-a6ef7ae15de9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:45.233081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-61ffe36d-9c02-4652-8855-a6ef7ae15de9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:45.233809 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-61ffe36d-9c02-4652-8855-a6ef7ae15de9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:45.234230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-61ffe36d-9c02-4652-8855-a6ef7ae15de9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:45.234670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-61ffe36d-9c02-4652-8855-a6ef7ae15de9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:45.362088 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-61ffe36d-9c02-4652-8855-a6ef7ae15de9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:45.370285 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-61ffe36d-9c02-4652-8855-a6ef7ae15de9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1723 microversion: 2.1 time: 0.149635 Sep 13 03:25:45.370901 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 244/512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:45 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:46.393886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-bbe5fe88-3d08-426a-9f40-c4502144c2d4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:46.394503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-bbe5fe88-3d08-426a-9f40-c4502144c2d4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:46.401299 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bbe5fe88-3d08-426a-9f40-c4502144c2d4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:46.401824 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bbe5fe88-3d08-426a-9f40-c4502144c2d4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:46.402257 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bbe5fe88-3d08-426a-9f40-c4502144c2d4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:46.402979 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bbe5fe88-3d08-426a-9f40-c4502144c2d4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:46.403431 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bbe5fe88-3d08-426a-9f40-c4502144c2d4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:46.403853 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bbe5fe88-3d08-426a-9f40-c4502144c2d4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:46.680218 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-bbe5fe88-3d08-426a-9f40-c4502144c2d4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:46.688339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-bbe5fe88-3d08-426a-9f40-c4502144c2d4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1723 microversion: 2.1 time: 0.298355 Sep 13 03:25:46.688898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 269/513] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:46 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:47.711329 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-712fd4d2-0572-4a72-8e24-229d847f0c8b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:47.711949 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-712fd4d2-0572-4a72-8e24-229d847f0c8b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:47.718839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-712fd4d2-0572-4a72-8e24-229d847f0c8b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:47.719326 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-712fd4d2-0572-4a72-8e24-229d847f0c8b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:47.719757 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-712fd4d2-0572-4a72-8e24-229d847f0c8b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:47.720441 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-712fd4d2-0572-4a72-8e24-229d847f0c8b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:47.720891 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-712fd4d2-0572-4a72-8e24-229d847f0c8b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:47.721313 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-712fd4d2-0572-4a72-8e24-229d847f0c8b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:47.853375 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-712fd4d2-0572-4a72-8e24-229d847f0c8b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:47.861397 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-712fd4d2-0572-4a72-8e24-229d847f0c8b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1723 microversion: 2.1 time: 0.153923 Sep 13 03:25:47.861954 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 245/514] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:47 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:48.884257 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4408ad4d-0ac5-4089-899a-857e017928a1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:48.884874 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4408ad4d-0ac5-4089-899a-857e017928a1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:48.891215 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4408ad4d-0ac5-4089-899a-857e017928a1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:48.891703 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4408ad4d-0ac5-4089-899a-857e017928a1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:48.892136 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4408ad4d-0ac5-4089-899a-857e017928a1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:48.892819 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4408ad4d-0ac5-4089-899a-857e017928a1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:48.893283 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4408ad4d-0ac5-4089-899a-857e017928a1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:48.893697 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4408ad4d-0ac5-4089-899a-857e017928a1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:49.021997 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4408ad4d-0ac5-4089-899a-857e017928a1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:49.030585 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4408ad4d-0ac5-4089-899a-857e017928a1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1723 microversion: 2.1 time: 0.150179 Sep 13 03:25:49.031172 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 270/515] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:48 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:50.054695 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-02447d65-ac9f-49e6-91d4-8d239823a692 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:50.055410 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-02447d65-ac9f-49e6-91d4-8d239823a692 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:50.062658 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-02447d65-ac9f-49e6-91d4-8d239823a692 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:50.063158 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-02447d65-ac9f-49e6-91d4-8d239823a692 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:50.063603 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-02447d65-ac9f-49e6-91d4-8d239823a692 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:50.064311 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-02447d65-ac9f-49e6-91d4-8d239823a692 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:50.064769 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-02447d65-ac9f-49e6-91d4-8d239823a692 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:50.065196 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-02447d65-ac9f-49e6-91d4-8d239823a692 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:50.270721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-02447d65-ac9f-49e6-91d4-8d239823a692 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:50.279270 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-02447d65-ac9f-49e6-91d4-8d239823a692 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1723 microversion: 2.1 time: 0.228488 Sep 13 03:25:50.279839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 246/516] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:50 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:25:51.302454 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1d5a1172-43b8-4a95-a7ff-295eb8be8ee9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:51.303133 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1d5a1172-43b8-4a95-a7ff-295eb8be8ee9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:51.309626 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1d5a1172-43b8-4a95-a7ff-295eb8be8ee9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:51.310116 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1d5a1172-43b8-4a95-a7ff-295eb8be8ee9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:51.310554 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1d5a1172-43b8-4a95-a7ff-295eb8be8ee9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:51.311421 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1d5a1172-43b8-4a95-a7ff-295eb8be8ee9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:51.311876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1d5a1172-43b8-4a95-a7ff-295eb8be8ee9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:51.312322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1d5a1172-43b8-4a95-a7ff-295eb8be8ee9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:51.445798 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1d5a1172-43b8-4a95-a7ff-295eb8be8ee9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:51.455027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1d5a1172-43b8-4a95-a7ff-295eb8be8ee9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1723 microversion: 2.1 time: 0.156451 Sep 13 03:25:51.455703 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 271/517] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:51 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:52.484070 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-16ccd2dc-ea13-4e03-819d-8961202dfb38 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:52.485412 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-16ccd2dc-ea13-4e03-819d-8961202dfb38 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:52.492628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-16ccd2dc-ea13-4e03-819d-8961202dfb38 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:52.493120 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-16ccd2dc-ea13-4e03-819d-8961202dfb38 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:52.493566 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-16ccd2dc-ea13-4e03-819d-8961202dfb38 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:52.494252 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-16ccd2dc-ea13-4e03-819d-8961202dfb38 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:52.494774 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-16ccd2dc-ea13-4e03-819d-8961202dfb38 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:52.495201 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-16ccd2dc-ea13-4e03-819d-8961202dfb38 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:52.662536 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-16ccd2dc-ea13-4e03-819d-8961202dfb38 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:52.672884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-16ccd2dc-ea13-4e03-819d-8961202dfb38 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1723 microversion: 2.1 time: 0.196278 Sep 13 03:25:52.673919 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 247/518] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:52 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:53.703784 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-af1504c7-89e6-4d66-9147-d065bcf15f4e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:53.705066 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-af1504c7-89e6-4d66-9147-d065bcf15f4e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:53.715922 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-af1504c7-89e6-4d66-9147-d065bcf15f4e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:53.716579 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-af1504c7-89e6-4d66-9147-d065bcf15f4e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:53.717026 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-af1504c7-89e6-4d66-9147-d065bcf15f4e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:53.719028 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-af1504c7-89e6-4d66-9147-d065bcf15f4e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:53.719499 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-af1504c7-89e6-4d66-9147-d065bcf15f4e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:53.719935 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-af1504c7-89e6-4d66-9147-d065bcf15f4e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:53.950437 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-af1504c7-89e6-4d66-9147-d065bcf15f4e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:53.959084 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-af1504c7-89e6-4d66-9147-d065bcf15f4e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1723 microversion: 2.1 time: 0.265716 Sep 13 03:25:53.959852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 272/519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:53 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:54.984243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5d6d2b01-ba13-425b-961d-cabd37ca6581 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:54.984914 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5d6d2b01-ba13-425b-961d-cabd37ca6581 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:54.992288 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5d6d2b01-ba13-425b-961d-cabd37ca6581 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:54.993026 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5d6d2b01-ba13-425b-961d-cabd37ca6581 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:54.994867 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5d6d2b01-ba13-425b-961d-cabd37ca6581 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:54.996115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5d6d2b01-ba13-425b-961d-cabd37ca6581 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:54.996831 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5d6d2b01-ba13-425b-961d-cabd37ca6581 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:54.997476 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5d6d2b01-ba13-425b-961d-cabd37ca6581 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:55.146066 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5d6d2b01-ba13-425b-961d-cabd37ca6581 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:55.170277 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5d6d2b01-ba13-425b-961d-cabd37ca6581 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1723 microversion: 2.1 time: 0.190758 Sep 13 03:25:55.174654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 248/520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:54 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:56.198315 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ed1ee94e-95aa-4a38-bef6-46230aa26f63 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:56.199148 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ed1ee94e-95aa-4a38-bef6-46230aa26f63 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:56.206891 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ed1ee94e-95aa-4a38-bef6-46230aa26f63 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:56.207441 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ed1ee94e-95aa-4a38-bef6-46230aa26f63 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:56.208047 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ed1ee94e-95aa-4a38-bef6-46230aa26f63 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:56.209385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ed1ee94e-95aa-4a38-bef6-46230aa26f63 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:56.209385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ed1ee94e-95aa-4a38-bef6-46230aa26f63 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:56.209953 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ed1ee94e-95aa-4a38-bef6-46230aa26f63 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:56.371376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ed1ee94e-95aa-4a38-bef6-46230aa26f63 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:56.380309 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ed1ee94e-95aa-4a38-bef6-46230aa26f63 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1723 microversion: 2.1 time: 0.187763 Sep 13 03:25:56.392660 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 273/521] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:56 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:57.405816 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d15f62d2-c98c-4bb2-aa4f-17edcf097d1b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:57.406437 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d15f62d2-c98c-4bb2-aa4f-17edcf097d1b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:57.409284 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 03:25:57.409426 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Tue Sep 13 03:25:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 (ip 10.222.0.18) !!! Sep 13 03:25:57.415125 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d15f62d2-c98c-4bb2-aa4f-17edcf097d1b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:57.415813 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d15f62d2-c98c-4bb2-aa4f-17edcf097d1b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:57.416560 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d15f62d2-c98c-4bb2-aa4f-17edcf097d1b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:57.417700 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d15f62d2-c98c-4bb2-aa4f-17edcf097d1b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:57.418500 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d15f62d2-c98c-4bb2-aa4f-17edcf097d1b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:57.419286 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d15f62d2-c98c-4bb2-aa4f-17edcf097d1b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:57.612625 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d15f62d2-c98c-4bb2-aa4f-17edcf097d1b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:57.626568 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d15f62d2-c98c-4bb2-aa4f-17edcf097d1b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1700 microversion: 2.1 time: 0.224531 Sep 13 03:25:57.627171 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 249/522] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:57 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1700 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:57.657534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-59988520-ada9-454d-b7dc-0ecfbb0d4d91 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:25:57.671282 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-59988520-ada9-454d-b7dc-0ecfbb0d4d91 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:57.671853 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-59988520-ada9-454d-b7dc-0ecfbb0d4d91 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:57.672303 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-59988520-ada9-454d-b7dc-0ecfbb0d4d91 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:57.754761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-59988520-ada9-454d-b7dc-0ecfbb0d4d91 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Going to try to start instance {{(pid=120383) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 03:25:57.856410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-59988520-ada9-454d-b7dc-0ecfbb0d4d91 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "POST /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/action" status: 202 len: 0 microversion: 2.1 time: 0.207832 Sep 13 03:25:57.857233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 274/523] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:25:57 2022] POST /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:25:57.865449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-be4b5ac9-d6c3-405a-8477-9ae56bbf5061 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:57.866063 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-be4b5ac9-d6c3-405a-8477-9ae56bbf5061 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:57.874402 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-be4b5ac9-d6c3-405a-8477-9ae56bbf5061 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:57.875324 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-be4b5ac9-d6c3-405a-8477-9ae56bbf5061 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:57.876408 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-be4b5ac9-d6c3-405a-8477-9ae56bbf5061 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:57.877740 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-be4b5ac9-d6c3-405a-8477-9ae56bbf5061 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:57.878733 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-be4b5ac9-d6c3-405a-8477-9ae56bbf5061 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:57.879512 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-be4b5ac9-d6c3-405a-8477-9ae56bbf5061 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:58.070579 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-be4b5ac9-d6c3-405a-8477-9ae56bbf5061 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:58.079414 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-be4b5ac9-d6c3-405a-8477-9ae56bbf5061 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1709 microversion: 2.1 time: 0.217746 Sep 13 03:25:58.079996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 250/524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:57 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1709 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:25:58.923167 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-489b915e-f4e4-4c9a-ae85-7dc707a9a3e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:58.924450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-489b915e-f4e4-4c9a-ae85-7dc707a9a3e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:58.948738 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-489b915e-f4e4-4c9a-ae85-7dc707a9a3e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:58.949659 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-489b915e-f4e4-4c9a-ae85-7dc707a9a3e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:58.950479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-489b915e-f4e4-4c9a-ae85-7dc707a9a3e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:58.958046 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-489b915e-f4e4-4c9a-ae85-7dc707a9a3e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:58.966353 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-489b915e-f4e4-4c9a-ae85-7dc707a9a3e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:58.968917 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-489b915e-f4e4-4c9a-ae85-7dc707a9a3e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:59.030451 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-489b915e-f4e4-4c9a-ae85-7dc707a9a3e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/ips" status: 200 len: 150 microversion: 2.20 time: 0.453411 Sep 13 03:25:59.036264 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 275/525] 10.222.0.18 () {60 vars in 1289 bytes} [Tue Sep 13 03:25:58 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/ips => generated 150 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:25:59.104765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7251ec27-f61f-4b7d-989b-5fa08a3d394b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:59.105391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7251ec27-f61f-4b7d-989b-5fa08a3d394b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:59.129402 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7251ec27-f61f-4b7d-989b-5fa08a3d394b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:59.130352 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7251ec27-f61f-4b7d-989b-5fa08a3d394b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:59.131057 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7251ec27-f61f-4b7d-989b-5fa08a3d394b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:59.132022 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7251ec27-f61f-4b7d-989b-5fa08a3d394b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:59.132681 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7251ec27-f61f-4b7d-989b-5fa08a3d394b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:59.133867 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7251ec27-f61f-4b7d-989b-5fa08a3d394b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:59.189226 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-60df1348-0ffa-463e-822b-8a6abadff8b7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:25:59.190446 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-60df1348-0ffa-463e-822b-8a6abadff8b7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:25:59.197893 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60df1348-0ffa-463e-822b-8a6abadff8b7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:59.202000 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60df1348-0ffa-463e-822b-8a6abadff8b7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:59.205484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60df1348-0ffa-463e-822b-8a6abadff8b7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:59.206660 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60df1348-0ffa-463e-822b-8a6abadff8b7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:25:59.211207 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60df1348-0ffa-463e-822b-8a6abadff8b7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:25:59.212060 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60df1348-0ffa-463e-822b-8a6abadff8b7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:25:59.265409 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-60df1348-0ffa-463e-822b-8a6abadff8b7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/ips" status: 200 len: 150 microversion: 2.1 time: 0.079933 Sep 13 03:25:59.270730 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 276/526] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 03:25:59 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/ips => generated 150 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:25:59.521615 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7251ec27-f61f-4b7d-989b-5fa08a3d394b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:25:59.549019 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7251ec27-f61f-4b7d-989b-5fa08a3d394b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1709 microversion: 2.1 time: 0.448915 Sep 13 03:25:59.555503 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 251/527] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:25:59 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1709 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:00.777887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9a828570-02cc-49b9-97a6-c8eeb23189e5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:00.778516 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9a828570-02cc-49b9-97a6-c8eeb23189e5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:00.784514 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9a828570-02cc-49b9-97a6-c8eeb23189e5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:00.785214 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9a828570-02cc-49b9-97a6-c8eeb23189e5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:00.785654 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9a828570-02cc-49b9-97a6-c8eeb23189e5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:00.786870 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9a828570-02cc-49b9-97a6-c8eeb23189e5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:00.787325 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9a828570-02cc-49b9-97a6-c8eeb23189e5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:00.787930 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9a828570-02cc-49b9-97a6-c8eeb23189e5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:00.943464 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9a828570-02cc-49b9-97a6-c8eeb23189e5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:00.954671 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9a828570-02cc-49b9-97a6-c8eeb23189e5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1713 microversion: 2.1 time: 0.373144 Sep 13 03:26:00.955773 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 277/528] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:00 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1713 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:01.698442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0db9c814-2a7f-4004-9a56-87de75b7f3c8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Action: 'create', calling method: .version_select at 0x7f8935824550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-196387094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNfJ9SZsy8vjZ8IGexip2BCGW2uF7wf1JORW8j33/a46gtlQGju7QbWjHaDu1qBEGGSYeYe7uAV2Dm0OasyxhEpjyXKh+kRj/ruJ4Wg35wPn7cAulAx6r8hQXS621BtqA=="}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:01.716662 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-0db9c814-2a7f-4004-9a56-87de75b7f3c8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Getting quotas for project ab6c92ba81254caaad368fd0ef382b0e. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:26:01.722709 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-0db9c814-2a7f-4004-9a56-87de75b7f3c8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Getting quotas for user 47fa1f7ce54145ceb3564b9ba7b4964f and project ab6c92ba81254caaad368fd0ef382b0e. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:26:01.767965 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0db9c814-2a7f-4004-9a56-87de75b7f3c8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.177403 Sep 13 03:26:01.768591 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 252/529] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 03:26:01 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:26:02.101567 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a9671873-8093-440d-8963-219160e391a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d043ba5-31f8-4fac-8514-c63d892ce155"}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:02.105743 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a9671873-8093-440d-8963-219160e391a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:02.114476 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a9671873-8093-440d-8963-219160e391a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:02.115490 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a9671873-8093-440d-8963-219160e391a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:02.116134 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a9671873-8093-440d-8963-219160e391a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:02.117050 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a9671873-8093-440d-8963-219160e391a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:02.118434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a9671873-8093-440d-8963-219160e391a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:02.119274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a9671873-8093-440d-8963-219160e391a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:02.256450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6c1f0259-bdae-4d8d-a3f6-95dd3dba91a8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:02.256988 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6c1f0259-bdae-4d8d-a3f6-95dd3dba91a8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:02.264180 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6c1f0259-bdae-4d8d-a3f6-95dd3dba91a8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:02.264698 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6c1f0259-bdae-4d8d-a3f6-95dd3dba91a8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:02.265714 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6c1f0259-bdae-4d8d-a3f6-95dd3dba91a8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:02.266441 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6c1f0259-bdae-4d8d-a3f6-95dd3dba91a8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:02.266932 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6c1f0259-bdae-4d8d-a3f6-95dd3dba91a8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:02.267362 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6c1f0259-bdae-4d8d-a3f6-95dd3dba91a8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:02.294425 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-6c1f0259-bdae-4d8d-a3f6-95dd3dba91a8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lazy-loading 'flavor' on Instance uuid a97f011a-6370-474e-9a62-e9229eb7d7ee {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:26:02.464211 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a9671873-8093-440d-8963-219160e391a0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368741 Sep 13 03:26:02.465792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 278/530] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:26:02 2022] POST /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:26:02.712812 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6c1f0259-bdae-4d8d-a3f6-95dd3dba91a8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "POST /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/action" status: 202 len: 0 microversion: 2.20 time: 0.459974 Sep 13 03:26:02.713771 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 253/531] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Sep 13 03:26:02 2022] POST /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:26:02.725989 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b0860f02-ccd1-44e8-ae2b-63a63c9320ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:02.727301 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b0860f02-ccd1-44e8-ae2b-63a63c9320ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:02.749581 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 03:26:02.749934 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Tue Sep 13 03:26:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee (ip 10.222.0.18) !!! Sep 13 03:26:02.756223 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0860f02-ccd1-44e8-ae2b-63a63c9320ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:02.756854 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0860f02-ccd1-44e8-ae2b-63a63c9320ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:02.757590 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0860f02-ccd1-44e8-ae2b-63a63c9320ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:02.759108 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0860f02-ccd1-44e8-ae2b-63a63c9320ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:02.760143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0860f02-ccd1-44e8-ae2b-63a63c9320ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:02.760846 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0860f02-ccd1-44e8-ae2b-63a63c9320ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:02.981769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b0860f02-ccd1-44e8-ae2b-63a63c9320ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:02.996968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b0860f02-ccd1-44e8-ae2b-63a63c9320ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:02.998762 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b0860f02-ccd1-44e8-ae2b-63a63c9320ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:03.000300 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b0860f02-ccd1-44e8-ae2b-63a63c9320ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.280787 Sep 13 03:26:03.001067 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 279/532] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:02 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:04.027051 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-da2a30e5-c96a-4422-82de-df1196fd49ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:04.027976 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-da2a30e5-c96a-4422-82de-df1196fd49ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:04.034080 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-da2a30e5-c96a-4422-82de-df1196fd49ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:04.034890 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-da2a30e5-c96a-4422-82de-df1196fd49ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:04.035333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-da2a30e5-c96a-4422-82de-df1196fd49ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:04.036047 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-da2a30e5-c96a-4422-82de-df1196fd49ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:04.036507 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-da2a30e5-c96a-4422-82de-df1196fd49ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:04.036932 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-da2a30e5-c96a-4422-82de-df1196fd49ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:04.179392 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-da2a30e5-c96a-4422-82de-df1196fd49ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:04.188158 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-da2a30e5-c96a-4422-82de-df1196fd49ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:04.189602 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-da2a30e5-c96a-4422-82de-df1196fd49ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:04.190843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-da2a30e5-c96a-4422-82de-df1196fd49ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.169141 Sep 13 03:26:04.191399 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 254/533] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:04 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:05.221137 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ba0337ae-acf8-4190-8d93-40bfea186f4e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:05.223089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ba0337ae-acf8-4190-8d93-40bfea186f4e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:05.233364 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba0337ae-acf8-4190-8d93-40bfea186f4e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:05.234778 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba0337ae-acf8-4190-8d93-40bfea186f4e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:05.235599 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba0337ae-acf8-4190-8d93-40bfea186f4e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:05.237303 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba0337ae-acf8-4190-8d93-40bfea186f4e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:05.238206 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba0337ae-acf8-4190-8d93-40bfea186f4e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:05.238841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba0337ae-acf8-4190-8d93-40bfea186f4e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:05.383345 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ba0337ae-acf8-4190-8d93-40bfea186f4e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:05.393255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ba0337ae-acf8-4190-8d93-40bfea186f4e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:05.395261 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ba0337ae-acf8-4190-8d93-40bfea186f4e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:05.396420 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ba0337ae-acf8-4190-8d93-40bfea186f4e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.184247 Sep 13 03:26:05.396981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 280/534] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:05 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:06.423125 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c425dfe8-2ed9-4664-aa31-e97cc5e806d3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:06.423713 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c425dfe8-2ed9-4664-aa31-e97cc5e806d3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:06.430150 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c425dfe8-2ed9-4664-aa31-e97cc5e806d3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:06.430652 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c425dfe8-2ed9-4664-aa31-e97cc5e806d3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:06.431087 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c425dfe8-2ed9-4664-aa31-e97cc5e806d3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:06.432398 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c425dfe8-2ed9-4664-aa31-e97cc5e806d3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:06.432846 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c425dfe8-2ed9-4664-aa31-e97cc5e806d3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:06.433639 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c425dfe8-2ed9-4664-aa31-e97cc5e806d3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:06.572262 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c425dfe8-2ed9-4664-aa31-e97cc5e806d3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:06.576043 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:06.581208 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c425dfe8-2ed9-4664-aa31-e97cc5e806d3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:06.582669 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c425dfe8-2ed9-4664-aa31-e97cc5e806d3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:06.583860 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c425dfe8-2ed9-4664-aa31-e97cc5e806d3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.165676 Sep 13 03:26:06.584412 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 255/535] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:06 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:07.609989 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1c6f1ba3-2e69-4885-b2e9-8f61b5588c1b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:07.610957 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1c6f1ba3-2e69-4885-b2e9-8f61b5588c1b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:07.621887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c6f1ba3-2e69-4885-b2e9-8f61b5588c1b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:07.622382 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c6f1ba3-2e69-4885-b2e9-8f61b5588c1b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:07.624305 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c6f1ba3-2e69-4885-b2e9-8f61b5588c1b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:07.625066 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c6f1ba3-2e69-4885-b2e9-8f61b5588c1b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:07.625582 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c6f1ba3-2e69-4885-b2e9-8f61b5588c1b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:07.625966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1c6f1ba3-2e69-4885-b2e9-8f61b5588c1b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:07.630312 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:07.767513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1c6f1ba3-2e69-4885-b2e9-8f61b5588c1b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:07.776526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1c6f1ba3-2e69-4885-b2e9-8f61b5588c1b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:07.777982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1c6f1ba3-2e69-4885-b2e9-8f61b5588c1b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:07.779196 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1c6f1ba3-2e69-4885-b2e9-8f61b5588c1b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.173750 Sep 13 03:26:07.779749 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 281/536] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:07 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:08.805025 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5196fe8a-d28f-4dae-9b96-1fab37f5bc33 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:08.805574 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5196fe8a-d28f-4dae-9b96-1fab37f5bc33 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:08.813996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5196fe8a-d28f-4dae-9b96-1fab37f5bc33 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:08.814484 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5196fe8a-d28f-4dae-9b96-1fab37f5bc33 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:08.814952 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5196fe8a-d28f-4dae-9b96-1fab37f5bc33 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:08.815647 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5196fe8a-d28f-4dae-9b96-1fab37f5bc33 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:08.816103 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5196fe8a-d28f-4dae-9b96-1fab37f5bc33 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:08.816526 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5196fe8a-d28f-4dae-9b96-1fab37f5bc33 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:08.957045 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5196fe8a-d28f-4dae-9b96-1fab37f5bc33 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:08.965576 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5196fe8a-d28f-4dae-9b96-1fab37f5bc33 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:08.967038 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5196fe8a-d28f-4dae-9b96-1fab37f5bc33 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:08.968191 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5196fe8a-d28f-4dae-9b96-1fab37f5bc33 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.167592 Sep 13 03:26:08.968767 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 256/537] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:08 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:09.993524 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-31b8b831-04e4-43be-8e76-8e6a02359c5c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:09.994665 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-31b8b831-04e4-43be-8e76-8e6a02359c5c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:10.001327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-31b8b831-04e4-43be-8e76-8e6a02359c5c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:10.001810 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-31b8b831-04e4-43be-8e76-8e6a02359c5c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:10.002242 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-31b8b831-04e4-43be-8e76-8e6a02359c5c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:10.002951 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-31b8b831-04e4-43be-8e76-8e6a02359c5c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:10.003405 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-31b8b831-04e4-43be-8e76-8e6a02359c5c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:10.003820 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-31b8b831-04e4-43be-8e76-8e6a02359c5c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:10.145512 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-31b8b831-04e4-43be-8e76-8e6a02359c5c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:10.153772 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-31b8b831-04e4-43be-8e76-8e6a02359c5c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:10.155158 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-31b8b831-04e4-43be-8e76-8e6a02359c5c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:10.156314 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-31b8b831-04e4-43be-8e76-8e6a02359c5c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.166693 Sep 13 03:26:10.156933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 282/538] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:09 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:11.185745 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e869191d-29f3-4778-8ae4-b01e358f5fa6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:11.186465 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e869191d-29f3-4778-8ae4-b01e358f5fa6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:11.192895 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e869191d-29f3-4778-8ae4-b01e358f5fa6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:11.193469 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e869191d-29f3-4778-8ae4-b01e358f5fa6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:11.193972 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e869191d-29f3-4778-8ae4-b01e358f5fa6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:11.194690 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e869191d-29f3-4778-8ae4-b01e358f5fa6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:11.195148 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e869191d-29f3-4778-8ae4-b01e358f5fa6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:11.195568 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e869191d-29f3-4778-8ae4-b01e358f5fa6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:11.275675 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ca01a777-49cc-4a4e-b56c-67eb481fe0d4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'create', calling method: .version_select at 0x7f893583ad30>, body: {"keypair": {"name": "tempest-keypair-2014592158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9oGrH0V9qTMHARbsDuglpReSRgoK4S3pecO9Ovyp9RXBl4S+V01bp08cm0DwqyWZf8YljQowI4OtA2whLecbxeUR//Mh4FNDVsiwRR5SpTsyXATVQ7fPaY3BoPoof9cQ=="}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:11.291386 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-ca01a777-49cc-4a4e-b56c-67eb481fe0d4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'key_pairs'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:26:11.295463 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-ca01a777-49cc-4a4e-b56c-67eb481fe0d4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for user 4f76a7c6fe9347b0bea5f701bccb6150 and project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'key_pairs'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:26:11.321134 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ca01a777-49cc-4a4e-b56c-67eb481fe0d4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049177 Sep 13 03:26:11.322094 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 283/539] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 03:26:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:26:11.326888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-e869191d-29f3-4778-8ae4-b01e358f5fa6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:11.336135 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-e869191d-29f3-4778-8ae4-b01e358f5fa6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:11.337562 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-e869191d-29f3-4778-8ae4-b01e358f5fa6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:11.338877 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e869191d-29f3-4778-8ae4-b01e358f5fa6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.157551 Sep 13 03:26:11.339434 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 257/540] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:11 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:12.365886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-bdaaa2a8-dd07-4623-8310-e997d5c6fade tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:12.366497 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-bdaaa2a8-dd07-4623-8310-e997d5c6fade tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:12.370396 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:12.375071 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bdaaa2a8-dd07-4623-8310-e997d5c6fade tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:12.375566 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bdaaa2a8-dd07-4623-8310-e997d5c6fade tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:12.376006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bdaaa2a8-dd07-4623-8310-e997d5c6fade tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:12.376705 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bdaaa2a8-dd07-4623-8310-e997d5c6fade tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:12.377163 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bdaaa2a8-dd07-4623-8310-e997d5c6fade tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:12.377591 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bdaaa2a8-dd07-4623-8310-e997d5c6fade tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:12.587571 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-bdaaa2a8-dd07-4623-8310-e997d5c6fade tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:12.595533 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-bdaaa2a8-dd07-4623-8310-e997d5c6fade tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:12.596973 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-bdaaa2a8-dd07-4623-8310-e997d5c6fade tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:12.598125 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-bdaaa2a8-dd07-4623-8310-e997d5c6fade tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.236752 Sep 13 03:26:12.598699 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 284/541] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:12 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:12.623557 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-498485611", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36a6ffba-7b10-4536-9b6f-36478b4a6ccb"}], "security_groups": [{"name": "tempest-securitygroup--1419487550"}], "key_name": "tempest-keypair-2014592158", "user_data": "}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:12.631896 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=4 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:12.633086 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:12.726689 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.network.neutron [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] validate_networks() for [('36a6ffba-7b10-4536-9b6f-36478b4a6ccb', None, None, None, None, None)] {{(pid=120384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:26:13.189517 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Flavor limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:26:13.189966 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Image limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:26:13.190435 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Flavor pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:26:13.190872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Image pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:26:13.191280 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:26:13.200366 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:13.200844 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:13.201279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:13.201998 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:13.202449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:13.202895 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:13.219549 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:26:13.223450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for user 4f76a7c6fe9347b0bea5f701bccb6150 and project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:26:13.234245 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Going to run 1 instances... {{(pid=120384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:26:13.236533 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:26:13.286037 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9cabef77-6b64-4030-bee4-5d02f8f5d354 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.667389 Sep 13 03:26:13.292894 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 258/542] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:26:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:26:13.297931 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-70163b01-8851-490f-b58f-1d870f1d0095 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:13.298543 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-70163b01-8851-490f-b58f-1d870f1d0095 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:13.352402 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-70163b01-8851-490f-b58f-1d870f1d0095 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:13.359410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-70163b01-8851-490f-b58f-1d870f1d0095 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1241 microversion: 2.1 time: 0.065280 Sep 13 03:26:13.359981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 285/543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:13 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:26:13.625446 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c598da7f-ccf8-4159-b58c-ddc883322df5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:13.625975 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c598da7f-ccf8-4159-b58c-ddc883322df5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:13.633697 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c598da7f-ccf8-4159-b58c-ddc883322df5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:13.634254 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c598da7f-ccf8-4159-b58c-ddc883322df5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:13.634722 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c598da7f-ccf8-4159-b58c-ddc883322df5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:13.635476 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c598da7f-ccf8-4159-b58c-ddc883322df5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:13.635962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c598da7f-ccf8-4159-b58c-ddc883322df5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:13.636946 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c598da7f-ccf8-4159-b58c-ddc883322df5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:13.774486 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c598da7f-ccf8-4159-b58c-ddc883322df5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:13.784258 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c598da7f-ccf8-4159-b58c-ddc883322df5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:13.786160 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c598da7f-ccf8-4159-b58c-ddc883322df5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:13.787538 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c598da7f-ccf8-4159-b58c-ddc883322df5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.168268 Sep 13 03:26:13.788615 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 259/544] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:13 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:14.382003 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d42022a5-43b9-402f-883c-c0e93e9f9335 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:14.382632 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d42022a5-43b9-402f-883c-c0e93e9f9335 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:14.390460 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d42022a5-43b9-402f-883c-c0e93e9f9335 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:14.390987 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d42022a5-43b9-402f-883c-c0e93e9f9335 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:14.391423 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d42022a5-43b9-402f-883c-c0e93e9f9335 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:14.392115 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d42022a5-43b9-402f-883c-c0e93e9f9335 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:14.392589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d42022a5-43b9-402f-883c-c0e93e9f9335 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:14.393021 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d42022a5-43b9-402f-883c-c0e93e9f9335 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:14.452330 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d42022a5-43b9-402f-883c-c0e93e9f9335 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:14.459790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d42022a5-43b9-402f-883c-c0e93e9f9335 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1245 microversion: 2.1 time: 0.081808 Sep 13 03:26:14.460349 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 286/545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:14 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:14.813072 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a24e3e32-2da9-41b7-9395-d878d5fd87a3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:14.813688 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a24e3e32-2da9-41b7-9395-d878d5fd87a3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:14.820088 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a24e3e32-2da9-41b7-9395-d878d5fd87a3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:14.820576 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a24e3e32-2da9-41b7-9395-d878d5fd87a3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:14.821014 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a24e3e32-2da9-41b7-9395-d878d5fd87a3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:14.822095 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a24e3e32-2da9-41b7-9395-d878d5fd87a3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:14.822786 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a24e3e32-2da9-41b7-9395-d878d5fd87a3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:14.823430 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a24e3e32-2da9-41b7-9395-d878d5fd87a3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:14.952482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a24e3e32-2da9-41b7-9395-d878d5fd87a3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:14.960518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a24e3e32-2da9-41b7-9395-d878d5fd87a3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:14.961967 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a24e3e32-2da9-41b7-9395-d878d5fd87a3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:14.963165 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a24e3e32-2da9-41b7-9395-d878d5fd87a3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.154000 Sep 13 03:26:14.963731 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 260/546] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:14 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:15.481341 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-052e4844-e134-48e7-b725-df16a7c7cf49 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:15.481949 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-052e4844-e134-48e7-b725-df16a7c7cf49 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:15.488461 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-052e4844-e134-48e7-b725-df16a7c7cf49 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:15.488975 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-052e4844-e134-48e7-b725-df16a7c7cf49 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:15.489410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-052e4844-e134-48e7-b725-df16a7c7cf49 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:15.490097 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-052e4844-e134-48e7-b725-df16a7c7cf49 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:15.490552 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-052e4844-e134-48e7-b725-df16a7c7cf49 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:15.491002 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-052e4844-e134-48e7-b725-df16a7c7cf49 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:15.553320 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-052e4844-e134-48e7-b725-df16a7c7cf49 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:15.560926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-052e4844-e134-48e7-b725-df16a7c7cf49 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1245 microversion: 2.1 time: 0.083453 Sep 13 03:26:15.561490 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 287/547] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:15 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:15.989048 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-645dd291-a468-46ac-adc7-383eda1044f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:15.989629 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-645dd291-a468-46ac-adc7-383eda1044f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:15.996698 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-645dd291-a468-46ac-adc7-383eda1044f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:15.997175 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-645dd291-a468-46ac-adc7-383eda1044f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:15.997605 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-645dd291-a468-46ac-adc7-383eda1044f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:15.998280 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-645dd291-a468-46ac-adc7-383eda1044f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:15.998764 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-645dd291-a468-46ac-adc7-383eda1044f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:15.999183 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-645dd291-a468-46ac-adc7-383eda1044f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:16.131610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-645dd291-a468-46ac-adc7-383eda1044f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:16.139554 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-645dd291-a468-46ac-adc7-383eda1044f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:16.140989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-645dd291-a468-46ac-adc7-383eda1044f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:16.142136 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-645dd291-a468-46ac-adc7-383eda1044f9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.156985 Sep 13 03:26:16.142702 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 261/548] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:15 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:16.584109 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2abb9773-335d-4fd7-8cc7-ffdd7a9cdd76 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:16.584819 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2abb9773-335d-4fd7-8cc7-ffdd7a9cdd76 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:16.591734 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2abb9773-335d-4fd7-8cc7-ffdd7a9cdd76 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:16.592221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2abb9773-335d-4fd7-8cc7-ffdd7a9cdd76 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:16.592659 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2abb9773-335d-4fd7-8cc7-ffdd7a9cdd76 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:16.593351 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2abb9773-335d-4fd7-8cc7-ffdd7a9cdd76 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:16.593808 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2abb9773-335d-4fd7-8cc7-ffdd7a9cdd76 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:16.594237 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2abb9773-335d-4fd7-8cc7-ffdd7a9cdd76 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:16.657064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2abb9773-335d-4fd7-8cc7-ffdd7a9cdd76 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:16.664837 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2abb9773-335d-4fd7-8cc7-ffdd7a9cdd76 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1245 microversion: 2.1 time: 0.084723 Sep 13 03:26:16.665396 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 288/549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:16 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:17.167282 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-913a54eb-a89f-4116-9e52-3c8dddedde32 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:17.167899 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-913a54eb-a89f-4116-9e52-3c8dddedde32 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:17.174211 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-913a54eb-a89f-4116-9e52-3c8dddedde32 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:17.174723 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-913a54eb-a89f-4116-9e52-3c8dddedde32 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:17.175161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-913a54eb-a89f-4116-9e52-3c8dddedde32 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:17.175841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-913a54eb-a89f-4116-9e52-3c8dddedde32 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:17.176293 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-913a54eb-a89f-4116-9e52-3c8dddedde32 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:17.176711 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-913a54eb-a89f-4116-9e52-3c8dddedde32 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:17.309569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-913a54eb-a89f-4116-9e52-3c8dddedde32 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:17.317695 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-913a54eb-a89f-4116-9e52-3c8dddedde32 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:17.319172 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-913a54eb-a89f-4116-9e52-3c8dddedde32 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:17.320326 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-913a54eb-a89f-4116-9e52-3c8dddedde32 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.157354 Sep 13 03:26:17.320874 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 262/550] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:17 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:17.688528 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9a128e1a-739c-43b1-a788-659709ea7722 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:17.689256 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9a128e1a-739c-43b1-a788-659709ea7722 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:17.695754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9a128e1a-739c-43b1-a788-659709ea7722 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:17.696237 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9a128e1a-739c-43b1-a788-659709ea7722 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:17.696671 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9a128e1a-739c-43b1-a788-659709ea7722 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:17.697359 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9a128e1a-739c-43b1-a788-659709ea7722 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:17.697812 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9a128e1a-739c-43b1-a788-659709ea7722 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:17.698229 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9a128e1a-739c-43b1-a788-659709ea7722 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:17.757152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9a128e1a-739c-43b1-a788-659709ea7722 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:17.764604 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9a128e1a-739c-43b1-a788-659709ea7722 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1245 microversion: 2.1 time: 0.079914 Sep 13 03:26:17.765164 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 289/551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:17 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:18.345963 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-510b76cd-a80c-49cf-9a2c-3f4fa536c072 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:18.347165 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-510b76cd-a80c-49cf-9a2c-3f4fa536c072 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:18.354080 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-510b76cd-a80c-49cf-9a2c-3f4fa536c072 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:18.354789 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-510b76cd-a80c-49cf-9a2c-3f4fa536c072 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:18.355518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-510b76cd-a80c-49cf-9a2c-3f4fa536c072 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:18.356043 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-510b76cd-a80c-49cf-9a2c-3f4fa536c072 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:18.356700 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-510b76cd-a80c-49cf-9a2c-3f4fa536c072 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:18.357257 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-510b76cd-a80c-49cf-9a2c-3f4fa536c072 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:18.495706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-510b76cd-a80c-49cf-9a2c-3f4fa536c072 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:18.503843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-510b76cd-a80c-49cf-9a2c-3f4fa536c072 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:18.505294 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-510b76cd-a80c-49cf-9a2c-3f4fa536c072 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:18.506451 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-510b76cd-a80c-49cf-9a2c-3f4fa536c072 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.164315 Sep 13 03:26:18.507032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 263/552] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:18 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:18.787080 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-90c2e972-fd14-4370-8cb6-227fe75499c5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:18.787706 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-90c2e972-fd14-4370-8cb6-227fe75499c5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:18.795039 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-90c2e972-fd14-4370-8cb6-227fe75499c5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:18.795533 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-90c2e972-fd14-4370-8cb6-227fe75499c5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:18.795977 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-90c2e972-fd14-4370-8cb6-227fe75499c5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:18.796671 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-90c2e972-fd14-4370-8cb6-227fe75499c5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:18.797130 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-90c2e972-fd14-4370-8cb6-227fe75499c5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:18.797561 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-90c2e972-fd14-4370-8cb6-227fe75499c5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:18.864535 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-90c2e972-fd14-4370-8cb6-227fe75499c5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:18.872341 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-90c2e972-fd14-4370-8cb6-227fe75499c5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1237 microversion: 2.1 time: 0.089119 Sep 13 03:26:18.872905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 290/553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:18 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:19.531674 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3af57943-e2b5-4b79-9ba6-960d713a175c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:19.532281 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3af57943-e2b5-4b79-9ba6-960d713a175c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:19.538977 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3af57943-e2b5-4b79-9ba6-960d713a175c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:19.539471 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3af57943-e2b5-4b79-9ba6-960d713a175c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:19.539929 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3af57943-e2b5-4b79-9ba6-960d713a175c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:19.540644 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3af57943-e2b5-4b79-9ba6-960d713a175c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:19.541092 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3af57943-e2b5-4b79-9ba6-960d713a175c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:19.541792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3af57943-e2b5-4b79-9ba6-960d713a175c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:19.678580 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3af57943-e2b5-4b79-9ba6-960d713a175c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:19.688474 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3af57943-e2b5-4b79-9ba6-960d713a175c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:19.690318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3af57943-e2b5-4b79-9ba6-960d713a175c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:19.691656 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3af57943-e2b5-4b79-9ba6-960d713a175c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.163780 Sep 13 03:26:19.693195 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 264/554] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:19 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:19.902321 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4695de4e-cc61-45bc-bde4-8acd82ccb66e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:19.903256 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4695de4e-cc61-45bc-bde4-8acd82ccb66e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:19.913591 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4695de4e-cc61-45bc-bde4-8acd82ccb66e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:19.914082 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4695de4e-cc61-45bc-bde4-8acd82ccb66e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:19.914512 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4695de4e-cc61-45bc-bde4-8acd82ccb66e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:19.915239 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4695de4e-cc61-45bc-bde4-8acd82ccb66e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:19.915691 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4695de4e-cc61-45bc-bde4-8acd82ccb66e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:19.916113 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4695de4e-cc61-45bc-bde4-8acd82ccb66e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:20.035207 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4695de4e-cc61-45bc-bde4-8acd82ccb66e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:20.045348 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4695de4e-cc61-45bc-bde4-8acd82ccb66e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1299 microversion: 2.1 time: 0.153389 Sep 13 03:26:20.046682 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 291/555] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:19 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:20.718569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b08f2914-7019-430e-8ac5-d35c9d4c0aea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:20.719230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b08f2914-7019-430e-8ac5-d35c9d4c0aea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:20.725953 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b08f2914-7019-430e-8ac5-d35c9d4c0aea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:20.726444 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b08f2914-7019-430e-8ac5-d35c9d4c0aea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:20.726988 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b08f2914-7019-430e-8ac5-d35c9d4c0aea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:20.727868 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b08f2914-7019-430e-8ac5-d35c9d4c0aea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:20.728322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b08f2914-7019-430e-8ac5-d35c9d4c0aea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:20.729078 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b08f2914-7019-430e-8ac5-d35c9d4c0aea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:20.863583 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b08f2914-7019-430e-8ac5-d35c9d4c0aea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:20.872212 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b08f2914-7019-430e-8ac5-d35c9d4c0aea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:20.873754 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b08f2914-7019-430e-8ac5-d35c9d4c0aea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:20.880509 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b08f2914-7019-430e-8ac5-d35c9d4c0aea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.166837 Sep 13 03:26:20.881240 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 265/556] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:20 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:21.070789 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b139f408-1e25-4fa4-813a-20e781597902 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:21.072553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b139f408-1e25-4fa4-813a-20e781597902 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:21.080964 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b139f408-1e25-4fa4-813a-20e781597902 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:21.081957 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b139f408-1e25-4fa4-813a-20e781597902 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:21.082580 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b139f408-1e25-4fa4-813a-20e781597902 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:21.083931 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b139f408-1e25-4fa4-813a-20e781597902 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:21.084727 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b139f408-1e25-4fa4-813a-20e781597902 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:21.085805 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b139f408-1e25-4fa4-813a-20e781597902 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:21.358066 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b139f408-1e25-4fa4-813a-20e781597902 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:21.366204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b139f408-1e25-4fa4-813a-20e781597902 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1367 microversion: 2.1 time: 0.299563 Sep 13 03:26:21.377470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 292/557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:21 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:21.535759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-edde0773-3654-428c-b992-77c224b2a70c req-c49a1136-47d4-47d3-89b5-87ee14428663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2620476c-6af0-419c-9d61-aeb1d1ee1457", "tag": "c759dcee-1328-4e27-8f62-118adab12265"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:21.546116 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-edde0773-3654-428c-b992-77c224b2a70c req-c49a1136-47d4-47d3-89b5-87ee14428663 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:21.546895 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-edde0773-3654-428c-b992-77c224b2a70c req-c49a1136-47d4-47d3-89b5-87ee14428663 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:21.547499 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-edde0773-3654-428c-b992-77c224b2a70c req-c49a1136-47d4-47d3-89b5-87ee14428663 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:21.558599 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-edde0773-3654-428c-b992-77c224b2a70c req-c49a1136-47d4-47d3-89b5-87ee14428663 service nova] Creating event network-changed:c759dcee-1328-4e27-8f62-118adab12265 for instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 on hv-cinder-85707 Sep 13 03:26:21.571756 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-edde0773-3654-428c-b992-77c224b2a70c req-c49a1136-47d4-47d3-89b5-87ee14428663 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039796 Sep 13 03:26:21.572793 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 266/558] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:26:21.912342 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d1228a8e-e38c-4450-9336-3d47ef90ab95 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:21.913320 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d1228a8e-e38c-4450-9336-3d47ef90ab95 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:21.920920 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1228a8e-e38c-4450-9336-3d47ef90ab95 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:21.921732 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1228a8e-e38c-4450-9336-3d47ef90ab95 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:21.922335 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1228a8e-e38c-4450-9336-3d47ef90ab95 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:21.923304 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1228a8e-e38c-4450-9336-3d47ef90ab95 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:21.923987 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1228a8e-e38c-4450-9336-3d47ef90ab95 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:21.924582 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1228a8e-e38c-4450-9336-3d47ef90ab95 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:22.113058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d1228a8e-e38c-4450-9336-3d47ef90ab95 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:22.122465 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d1228a8e-e38c-4450-9336-3d47ef90ab95 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:22.123924 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d1228a8e-e38c-4450-9336-3d47ef90ab95 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:22.125071 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d1228a8e-e38c-4450-9336-3d47ef90ab95 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.221894 Sep 13 03:26:22.125629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 293/559] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:21 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:22.390308 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b4d1be7c-a547-470a-b0bd-a0c675bc5880 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:22.391031 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b4d1be7c-a547-470a-b0bd-a0c675bc5880 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:22.397190 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b4d1be7c-a547-470a-b0bd-a0c675bc5880 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:22.397677 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b4d1be7c-a547-470a-b0bd-a0c675bc5880 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:22.398114 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b4d1be7c-a547-470a-b0bd-a0c675bc5880 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:22.398857 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b4d1be7c-a547-470a-b0bd-a0c675bc5880 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:22.399313 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b4d1be7c-a547-470a-b0bd-a0c675bc5880 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:22.399738 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b4d1be7c-a547-470a-b0bd-a0c675bc5880 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:22.528485 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b4d1be7c-a547-470a-b0bd-a0c675bc5880 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:22.536007 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b4d1be7c-a547-470a-b0bd-a0c675bc5880 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1367 microversion: 2.1 time: 0.150297 Sep 13 03:26:22.536575 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 267/560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:22 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:23.149894 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-50cf4292-0194-4b16-a01e-6c4a63c1cfb7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:23.150506 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-50cf4292-0194-4b16-a01e-6c4a63c1cfb7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:23.156922 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-50cf4292-0194-4b16-a01e-6c4a63c1cfb7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:23.157405 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-50cf4292-0194-4b16-a01e-6c4a63c1cfb7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:23.157840 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-50cf4292-0194-4b16-a01e-6c4a63c1cfb7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:23.158527 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-50cf4292-0194-4b16-a01e-6c4a63c1cfb7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:23.159012 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-50cf4292-0194-4b16-a01e-6c4a63c1cfb7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:23.159434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-50cf4292-0194-4b16-a01e-6c4a63c1cfb7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:23.289496 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-50cf4292-0194-4b16-a01e-6c4a63c1cfb7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:23.297977 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-50cf4292-0194-4b16-a01e-6c4a63c1cfb7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:23.299305 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-50cf4292-0194-4b16-a01e-6c4a63c1cfb7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:23.300467 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-50cf4292-0194-4b16-a01e-6c4a63c1cfb7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.154535 Sep 13 03:26:23.301018 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 294/561] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:23 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:23.560109 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6dbdffc5-6582-43e8-b06f-0733126b0699 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:23.560721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6dbdffc5-6582-43e8-b06f-0733126b0699 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:23.562671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:23.563389 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=6 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:23.569609 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6dbdffc5-6582-43e8-b06f-0733126b0699 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:23.570092 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6dbdffc5-6582-43e8-b06f-0733126b0699 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:23.570525 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6dbdffc5-6582-43e8-b06f-0733126b0699 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:23.571236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6dbdffc5-6582-43e8-b06f-0733126b0699 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:23.571693 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6dbdffc5-6582-43e8-b06f-0733126b0699 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:23.572119 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6dbdffc5-6582-43e8-b06f-0733126b0699 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:23.698006 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-6dbdffc5-6582-43e8-b06f-0733126b0699 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:23.705604 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6dbdffc5-6582-43e8-b06f-0733126b0699 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1367 microversion: 2.1 time: 0.149961 Sep 13 03:26:23.706168 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 268/562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:23 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:24.325750 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-83c145f1-7eed-4350-91b4-1cb0e845bc41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:24.326288 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-83c145f1-7eed-4350-91b4-1cb0e845bc41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:24.328126 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=6 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:24.333894 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-83c145f1-7eed-4350-91b4-1cb0e845bc41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:24.334372 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-83c145f1-7eed-4350-91b4-1cb0e845bc41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:24.334861 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-83c145f1-7eed-4350-91b4-1cb0e845bc41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:24.335546 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-83c145f1-7eed-4350-91b4-1cb0e845bc41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:24.335996 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-83c145f1-7eed-4350-91b4-1cb0e845bc41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:24.336416 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-83c145f1-7eed-4350-91b4-1cb0e845bc41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:24.464915 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-83c145f1-7eed-4350-91b4-1cb0e845bc41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:24.472828 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-83c145f1-7eed-4350-91b4-1cb0e845bc41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:24.474272 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-83c145f1-7eed-4350-91b4-1cb0e845bc41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:24.475443 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-83c145f1-7eed-4350-91b4-1cb0e845bc41 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.153627 Sep 13 03:26:24.475996 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 295/563] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:24 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:24.727883 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-85be824e-3557-434f-a3e5-31ce8ccd9e39 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:24.728492 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-85be824e-3557-434f-a3e5-31ce8ccd9e39 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:24.735430 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-85be824e-3557-434f-a3e5-31ce8ccd9e39 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:24.735916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-85be824e-3557-434f-a3e5-31ce8ccd9e39 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:24.736351 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-85be824e-3557-434f-a3e5-31ce8ccd9e39 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:24.737033 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-85be824e-3557-434f-a3e5-31ce8ccd9e39 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:24.737486 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-85be824e-3557-434f-a3e5-31ce8ccd9e39 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:24.737908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-85be824e-3557-434f-a3e5-31ce8ccd9e39 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:24.870144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-85be824e-3557-434f-a3e5-31ce8ccd9e39 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:24.877645 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-85be824e-3557-434f-a3e5-31ce8ccd9e39 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1367 microversion: 2.1 time: 0.153550 Sep 13 03:26:24.878209 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 269/564] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:24 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:25.500531 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e54f1b7b-f35d-4ca4-ac2e-c801de57c014 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:25.501170 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e54f1b7b-f35d-4ca4-ac2e-c801de57c014 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:25.507603 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e54f1b7b-f35d-4ca4-ac2e-c801de57c014 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:25.508084 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e54f1b7b-f35d-4ca4-ac2e-c801de57c014 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:25.508519 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e54f1b7b-f35d-4ca4-ac2e-c801de57c014 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:25.509200 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e54f1b7b-f35d-4ca4-ac2e-c801de57c014 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:25.509651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e54f1b7b-f35d-4ca4-ac2e-c801de57c014 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:25.510074 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e54f1b7b-f35d-4ca4-ac2e-c801de57c014 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:25.634643 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e54f1b7b-f35d-4ca4-ac2e-c801de57c014 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:25.642552 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e54f1b7b-f35d-4ca4-ac2e-c801de57c014 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:25.644010 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e54f1b7b-f35d-4ca4-ac2e-c801de57c014 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:25.645167 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e54f1b7b-f35d-4ca4-ac2e-c801de57c014 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.148511 Sep 13 03:26:25.645727 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 296/565] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:25 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:25.900084 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-778af0e0-4257-4a53-9f97-6bea2f1fc03d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:25.900616 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-778af0e0-4257-4a53-9f97-6bea2f1fc03d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:25.907444 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-778af0e0-4257-4a53-9f97-6bea2f1fc03d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:25.907926 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-778af0e0-4257-4a53-9f97-6bea2f1fc03d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:25.908355 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-778af0e0-4257-4a53-9f97-6bea2f1fc03d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:25.909043 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-778af0e0-4257-4a53-9f97-6bea2f1fc03d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:25.909493 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-778af0e0-4257-4a53-9f97-6bea2f1fc03d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:25.909913 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-778af0e0-4257-4a53-9f97-6bea2f1fc03d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:26.035244 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-778af0e0-4257-4a53-9f97-6bea2f1fc03d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:26.043086 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-778af0e0-4257-4a53-9f97-6bea2f1fc03d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1367 microversion: 2.1 time: 0.146857 Sep 13 03:26:26.043637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 270/566] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:25 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:26.671275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-60752731-69d2-474f-8412-22c456ef5d3a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:26.672010 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-60752731-69d2-474f-8412-22c456ef5d3a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:26.678328 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60752731-69d2-474f-8412-22c456ef5d3a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:26.678841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60752731-69d2-474f-8412-22c456ef5d3a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:26.679277 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60752731-69d2-474f-8412-22c456ef5d3a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:26.679958 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60752731-69d2-474f-8412-22c456ef5d3a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:26.680405 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60752731-69d2-474f-8412-22c456ef5d3a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:26.680830 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60752731-69d2-474f-8412-22c456ef5d3a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:26.844449 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-60752731-69d2-474f-8412-22c456ef5d3a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:26.853164 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-60752731-69d2-474f-8412-22c456ef5d3a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:26.854594 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-60752731-69d2-474f-8412-22c456ef5d3a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:26.855774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-60752731-69d2-474f-8412-22c456ef5d3a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.189238 Sep 13 03:26:26.856322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 297/567] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:26 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:27.066051 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7335c968-c234-4fee-b21d-9319371144e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:27.066784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7335c968-c234-4fee-b21d-9319371144e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:27.073412 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7335c968-c234-4fee-b21d-9319371144e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:27.073899 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7335c968-c234-4fee-b21d-9319371144e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:27.074328 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7335c968-c234-4fee-b21d-9319371144e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:27.075624 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7335c968-c234-4fee-b21d-9319371144e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:27.076072 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7335c968-c234-4fee-b21d-9319371144e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:27.076488 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7335c968-c234-4fee-b21d-9319371144e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:27.206081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7335c968-c234-4fee-b21d-9319371144e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:27.213885 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7335c968-c234-4fee-b21d-9319371144e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1367 microversion: 2.1 time: 0.152473 Sep 13 03:26:27.215106 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 271/568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:27 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:27.881079 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-27b1114c-356f-4ed7-a876-91001b0d678d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:27.881722 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-27b1114c-356f-4ed7-a876-91001b0d678d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:27.888680 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27b1114c-356f-4ed7-a876-91001b0d678d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:27.889161 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27b1114c-356f-4ed7-a876-91001b0d678d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:27.889597 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27b1114c-356f-4ed7-a876-91001b0d678d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:27.890292 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27b1114c-356f-4ed7-a876-91001b0d678d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:27.890766 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27b1114c-356f-4ed7-a876-91001b0d678d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:27.891190 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27b1114c-356f-4ed7-a876-91001b0d678d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:28.017603 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-27b1114c-356f-4ed7-a876-91001b0d678d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:28.025646 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-27b1114c-356f-4ed7-a876-91001b0d678d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:28.027102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-27b1114c-356f-4ed7-a876-91001b0d678d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:28.028250 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-27b1114c-356f-4ed7-a876-91001b0d678d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.151109 Sep 13 03:26:28.028792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 298/569] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:27 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:28.236944 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2a7ebf9f-8a73-4126-b5f6-95fbdc553a00 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:28.237558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2a7ebf9f-8a73-4126-b5f6-95fbdc553a00 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:28.243911 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2a7ebf9f-8a73-4126-b5f6-95fbdc553a00 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:28.244387 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2a7ebf9f-8a73-4126-b5f6-95fbdc553a00 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:28.244815 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2a7ebf9f-8a73-4126-b5f6-95fbdc553a00 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:28.245489 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2a7ebf9f-8a73-4126-b5f6-95fbdc553a00 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:28.245938 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2a7ebf9f-8a73-4126-b5f6-95fbdc553a00 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:28.246354 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2a7ebf9f-8a73-4126-b5f6-95fbdc553a00 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:28.376114 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2a7ebf9f-8a73-4126-b5f6-95fbdc553a00 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:28.383594 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2a7ebf9f-8a73-4126-b5f6-95fbdc553a00 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1367 microversion: 2.1 time: 0.150500 Sep 13 03:26:28.384153 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 272/570] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:28 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:29.053209 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3f7bcce1-6e42-4f7a-8a83-598d1d3f711f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:29.053809 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3f7bcce1-6e42-4f7a-8a83-598d1d3f711f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:29.060781 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f7bcce1-6e42-4f7a-8a83-598d1d3f711f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:29.061260 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f7bcce1-6e42-4f7a-8a83-598d1d3f711f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:29.061688 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f7bcce1-6e42-4f7a-8a83-598d1d3f711f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:29.062368 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f7bcce1-6e42-4f7a-8a83-598d1d3f711f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:29.062845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f7bcce1-6e42-4f7a-8a83-598d1d3f711f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:29.063261 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f7bcce1-6e42-4f7a-8a83-598d1d3f711f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:29.193450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3f7bcce1-6e42-4f7a-8a83-598d1d3f711f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:29.196952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:29.202246 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3f7bcce1-6e42-4f7a-8a83-598d1d3f711f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:29.203716 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3f7bcce1-6e42-4f7a-8a83-598d1d3f711f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:29.204863 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3f7bcce1-6e42-4f7a-8a83-598d1d3f711f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.155491 Sep 13 03:26:29.205413 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 299/571] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:29 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:29.407351 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f5ead071-fd00-43e6-be74-f37d7bcb36f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:29.407884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f5ead071-fd00-43e6-be74-f37d7bcb36f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:29.414170 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f5ead071-fd00-43e6-be74-f37d7bcb36f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:29.414692 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f5ead071-fd00-43e6-be74-f37d7bcb36f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:29.415134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f5ead071-fd00-43e6-be74-f37d7bcb36f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:29.415814 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f5ead071-fd00-43e6-be74-f37d7bcb36f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:29.416266 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f5ead071-fd00-43e6-be74-f37d7bcb36f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:29.416951 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f5ead071-fd00-43e6-be74-f37d7bcb36f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:29.542249 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f5ead071-fd00-43e6-be74-f37d7bcb36f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:29.545629 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=100 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:29.550601 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f5ead071-fd00-43e6-be74-f37d7bcb36f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1367 microversion: 2.1 time: 0.147713 Sep 13 03:26:29.551261 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 273/572] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:29 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:30.230166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-27e40489-3c23-4e2c-9d08-e6f8a4551a49 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:30.230801 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-27e40489-3c23-4e2c-9d08-e6f8a4551a49 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:30.238136 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27e40489-3c23-4e2c-9d08-e6f8a4551a49 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:30.238650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27e40489-3c23-4e2c-9d08-e6f8a4551a49 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:30.239095 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27e40489-3c23-4e2c-9d08-e6f8a4551a49 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:30.239916 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27e40489-3c23-4e2c-9d08-e6f8a4551a49 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:30.240379 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27e40489-3c23-4e2c-9d08-e6f8a4551a49 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:30.240806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27e40489-3c23-4e2c-9d08-e6f8a4551a49 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:30.374942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-27e40489-3c23-4e2c-9d08-e6f8a4551a49 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:30.382991 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-27e40489-3c23-4e2c-9d08-e6f8a4551a49 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:30.384428 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-27e40489-3c23-4e2c-9d08-e6f8a4551a49 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:30.385574 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-27e40489-3c23-4e2c-9d08-e6f8a4551a49 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1744 microversion: 2.20 time: 0.159588 Sep 13 03:26:30.386137 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 300/573] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:30 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:30.420922 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-5b771b69-3cee-4538-8175-6d426959d1fa req-ca68289e-bc3d-416a-bec7-20b3ac6e3ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2620476c-6af0-419c-9d61-aeb1d1ee1457", "name": "network-vif-plugged", "status": "completed", "tag": "c759dcee-1328-4e27-8f62-118adab12265"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:30.431237 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-5b771b69-3cee-4538-8175-6d426959d1fa req-ca68289e-bc3d-416a-bec7-20b3ac6e3ed1 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:30.431719 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-5b771b69-3cee-4538-8175-6d426959d1fa req-ca68289e-bc3d-416a-bec7-20b3ac6e3ed1 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:30.432149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-5b771b69-3cee-4538-8175-6d426959d1fa req-ca68289e-bc3d-416a-bec7-20b3ac6e3ed1 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:30.443731 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-5b771b69-3cee-4538-8175-6d426959d1fa req-ca68289e-bc3d-416a-bec7-20b3ac6e3ed1 service nova] Creating event network-vif-plugged:c759dcee-1328-4e27-8f62-118adab12265 for instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 on hv-cinder-85707 Sep 13 03:26:30.448556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-5b771b69-3cee-4538-8175-6d426959d1fa req-ca68289e-bc3d-416a-bec7-20b3ac6e3ed1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032007 Sep 13 03:26:30.449161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 274/574] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:26:30.572217 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7954b1d4-6261-4cf4-a589-67a992ff10cd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:30.572892 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7954b1d4-6261-4cf4-a589-67a992ff10cd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:30.578767 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7954b1d4-6261-4cf4-a589-67a992ff10cd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:30.579256 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7954b1d4-6261-4cf4-a589-67a992ff10cd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:30.579696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7954b1d4-6261-4cf4-a589-67a992ff10cd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:30.580385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7954b1d4-6261-4cf4-a589-67a992ff10cd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:30.580840 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7954b1d4-6261-4cf4-a589-67a992ff10cd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:30.581266 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7954b1d4-6261-4cf4-a589-67a992ff10cd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:30.754852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7954b1d4-6261-4cf4-a589-67a992ff10cd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:30.762407 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7954b1d4-6261-4cf4-a589-67a992ff10cd tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1367 microversion: 2.1 time: 0.194048 Sep 13 03:26:30.763034 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 301/575] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:30 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:31.411497 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-fc65ba44-0177-4625-80cd-aeffde97c402 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:31.412115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-fc65ba44-0177-4625-80cd-aeffde97c402 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:31.418498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fc65ba44-0177-4625-80cd-aeffde97c402 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:31.419010 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fc65ba44-0177-4625-80cd-aeffde97c402 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:31.419445 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fc65ba44-0177-4625-80cd-aeffde97c402 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:31.420126 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fc65ba44-0177-4625-80cd-aeffde97c402 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:31.420581 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fc65ba44-0177-4625-80cd-aeffde97c402 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:31.421008 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fc65ba44-0177-4625-80cd-aeffde97c402 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:31.550418 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-fc65ba44-0177-4625-80cd-aeffde97c402 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:31.558408 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-fc65ba44-0177-4625-80cd-aeffde97c402 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:31.560383 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-fc65ba44-0177-4625-80cd-aeffde97c402 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:31.561526 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-fc65ba44-0177-4625-80cd-aeffde97c402 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1744 microversion: 2.20 time: 0.154418 Sep 13 03:26:31.562086 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 275/576] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:31 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:31.785005 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-fa2be840-59b5-4697-8ea4-280573334592 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:31.785609 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-fa2be840-59b5-4697-8ea4-280573334592 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:31.792152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fa2be840-59b5-4697-8ea4-280573334592 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:31.792628 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fa2be840-59b5-4697-8ea4-280573334592 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:31.793058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fa2be840-59b5-4697-8ea4-280573334592 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:31.794243 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fa2be840-59b5-4697-8ea4-280573334592 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:31.794719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fa2be840-59b5-4697-8ea4-280573334592 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:31.795134 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fa2be840-59b5-4697-8ea4-280573334592 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:31.924216 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-fa2be840-59b5-4697-8ea4-280573334592 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:31.931808 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-fa2be840-59b5-4697-8ea4-280573334592 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1367 microversion: 2.1 time: 0.150698 Sep 13 03:26:31.932368 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 302/577] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:31 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:32.587062 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7aadd6a9-5e99-4293-b2b7-e4ac7ffd6b24 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:32.587674 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7aadd6a9-5e99-4293-b2b7-e4ac7ffd6b24 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:32.593705 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7aadd6a9-5e99-4293-b2b7-e4ac7ffd6b24 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:32.594195 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7aadd6a9-5e99-4293-b2b7-e4ac7ffd6b24 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:32.594650 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7aadd6a9-5e99-4293-b2b7-e4ac7ffd6b24 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:32.595343 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7aadd6a9-5e99-4293-b2b7-e4ac7ffd6b24 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:32.595808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7aadd6a9-5e99-4293-b2b7-e4ac7ffd6b24 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:32.596230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7aadd6a9-5e99-4293-b2b7-e4ac7ffd6b24 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:32.725428 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7aadd6a9-5e99-4293-b2b7-e4ac7ffd6b24 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:32.733842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7aadd6a9-5e99-4293-b2b7-e4ac7ffd6b24 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:32.735302 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7aadd6a9-5e99-4293-b2b7-e4ac7ffd6b24 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:32.736454 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7aadd6a9-5e99-4293-b2b7-e4ac7ffd6b24 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1744 microversion: 2.20 time: 0.153526 Sep 13 03:26:32.737012 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 276/578] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:32 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:32.953823 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6d71dbf2-a65d-4e88-9c48-a2c130f0732e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:32.954357 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6d71dbf2-a65d-4e88-9c48-a2c130f0732e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:32.960636 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6d71dbf2-a65d-4e88-9c48-a2c130f0732e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:32.961119 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6d71dbf2-a65d-4e88-9c48-a2c130f0732e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:32.961587 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6d71dbf2-a65d-4e88-9c48-a2c130f0732e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:32.962268 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6d71dbf2-a65d-4e88-9c48-a2c130f0732e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:32.962751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6d71dbf2-a65d-4e88-9c48-a2c130f0732e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:32.963174 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6d71dbf2-a65d-4e88-9c48-a2c130f0732e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:33.095447 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6d71dbf2-a65d-4e88-9c48-a2c130f0732e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:33.103209 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6d71dbf2-a65d-4e88-9c48-a2c130f0732e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1367 microversion: 2.1 time: 0.153343 Sep 13 03:26:33.104033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 303/579] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:32 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:33.477232 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1552616293", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-196387094", "security_groups": [{"name": "tempest-secgroup-smoke-2028642222"}], "block_device_mapping_v2": [{"uuid": "0357ddbe-3aa4-461a-acc4-22333d924c4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "93f6860d-aa52-425f-a0b7-a39e9fc582c8"}]}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:33.588927 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.network.neutron [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] validate_networks() for [('93f6860d-aa52-425f-a0b7-a39e9fc582c8', None, None, None, None, None)] {{(pid=120384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:26:33.761434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-286fa492-b715-4215-adf1-1599ac81b1fe tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:33.762065 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-286fa492-b715-4215-adf1-1599ac81b1fe tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:33.768222 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-286fa492-b715-4215-adf1-1599ac81b1fe tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:33.768719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-286fa492-b715-4215-adf1-1599ac81b1fe tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:33.769150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-286fa492-b715-4215-adf1-1599ac81b1fe tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:33.769847 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-286fa492-b715-4215-adf1-1599ac81b1fe tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:33.770372 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-286fa492-b715-4215-adf1-1599ac81b1fe tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:33.770761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-286fa492-b715-4215-adf1-1599ac81b1fe tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:33.913573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-286fa492-b715-4215-adf1-1599ac81b1fe tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:33.922003 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-286fa492-b715-4215-adf1-1599ac81b1fe tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:33.923498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-286fa492-b715-4215-adf1-1599ac81b1fe tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:33.925457 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-286fa492-b715-4215-adf1-1599ac81b1fe tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1744 microversion: 2.20 time: 0.168087 Sep 13 03:26:33.926008 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 304/580] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:33 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:26:33.967936 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Flavor limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:26:33.968354 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Image limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:26:33.968839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Flavor pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:26:33.969241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Image pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:26:33.969643 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:26:33.978210 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:33.978722 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:33.979154 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:33.979870 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:33.980321 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:33.980739 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:33.997775 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Getting quotas for project ab6c92ba81254caaad368fd0ef382b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:26:34.001684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Getting quotas for user 47fa1f7ce54145ceb3564b9ba7b4964f and project ab6c92ba81254caaad368fd0ef382b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:26:34.056329 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Going to run 1 instances... {{(pid=120384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:26:34.058446 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0357ddbe-3aa4-461a-acc4-22333d924c4e',volume_size=None,volume_type=None)] {{(pid=120384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:26:34.126540 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0ef92df9-96ac-42d7-b9eb-2c8f2fb31595 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:34.127180 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0ef92df9-96ac-42d7-b9eb-2c8f2fb31595 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:34.133226 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0ef92df9-96ac-42d7-b9eb-2c8f2fb31595 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:34.133771 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0ef92df9-96ac-42d7-b9eb-2c8f2fb31595 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:34.134301 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0ef92df9-96ac-42d7-b9eb-2c8f2fb31595 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:34.135150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0ef92df9-96ac-42d7-b9eb-2c8f2fb31595 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:34.135600 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0ef92df9-96ac-42d7-b9eb-2c8f2fb31595 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:34.136103 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0ef92df9-96ac-42d7-b9eb-2c8f2fb31595 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:34.187002 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-14ef7928-4a7f-4d61-bd80-1d0ffc5288fe tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713503 Sep 13 03:26:34.193746 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 277/581] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:26:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:26:34.199076 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-61f3d3d9-93cf-4986-8718-7b73038bb857 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:34.199679 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-61f3d3d9-93cf-4986-8718-7b73038bb857 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:34.260522 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-61f3d3d9-93cf-4986-8718-7b73038bb857 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:34.268088 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-61f3d3d9-93cf-4986-8718-7b73038bb857 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1094 microversion: 2.1 time: 0.073180 Sep 13 03:26:34.268653 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 278/582] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:34 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:26:34.280723 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0ef92df9-96ac-42d7-b9eb-2c8f2fb31595 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:34.291654 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0ef92df9-96ac-42d7-b9eb-2c8f2fb31595 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1557 microversion: 2.1 time: 0.168942 Sep 13 03:26:34.292378 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 305/583] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:34 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:26:34.314970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-47f931cd-f19c-4c66-a1a4-9e076e8794fc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:34.315468 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-47f931cd-f19c-4c66-a1a4-9e076e8794fc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:34.321455 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47f931cd-f19c-4c66-a1a4-9e076e8794fc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:34.321941 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47f931cd-f19c-4c66-a1a4-9e076e8794fc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:34.322474 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47f931cd-f19c-4c66-a1a4-9e076e8794fc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:34.323091 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47f931cd-f19c-4c66-a1a4-9e076e8794fc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:34.323542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47f931cd-f19c-4c66-a1a4-9e076e8794fc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:34.323961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47f931cd-f19c-4c66-a1a4-9e076e8794fc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:34.408398 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-47f931cd-f19c-4c66-a1a4-9e076e8794fc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097249 Sep 13 03:26:34.409200 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 279/584] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 03:26:34 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:26:34.458490 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-8e3cadf5-8d10-43c5-bddd-03050b625e4e req-d5cd5f30-7fda-451d-b278-17ee77d624d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97f011a-6370-474e-9a62-e9229eb7d7ee", "name": "network-vif-plugged", "status": "completed", "tag": "1c922edb-7dd6-4a91-ba67-004272056f1c"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:34.470730 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-8e3cadf5-8d10-43c5-bddd-03050b625e4e req-d5cd5f30-7fda-451d-b278-17ee77d624d1 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:34.471220 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-8e3cadf5-8d10-43c5-bddd-03050b625e4e req-d5cd5f30-7fda-451d-b278-17ee77d624d1 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:34.471708 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-8e3cadf5-8d10-43c5-bddd-03050b625e4e req-d5cd5f30-7fda-451d-b278-17ee77d624d1 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:34.484575 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-8e3cadf5-8d10-43c5-bddd-03050b625e4e req-d5cd5f30-7fda-451d-b278-17ee77d624d1 service nova] Creating event network-vif-plugged:1c922edb-7dd6-4a91-ba67-004272056f1c for instance a97f011a-6370-474e-9a62-e9229eb7d7ee on hv-cinder-85707 Sep 13 03:26:34.489931 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-8e3cadf5-8d10-43c5-bddd-03050b625e4e req-d5cd5f30-7fda-451d-b278-17ee77d624d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036429 Sep 13 03:26:34.490542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 306/585] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:26:34.951090 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1ed80b0d-2262-4164-a39d-a86f2ef9b906 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:34.952282 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-1ed80b0d-2262-4164-a39d-a86f2ef9b906 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:34.958279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ed80b0d-2262-4164-a39d-a86f2ef9b906 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:34.958973 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ed80b0d-2262-4164-a39d-a86f2ef9b906 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:34.959491 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ed80b0d-2262-4164-a39d-a86f2ef9b906 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:34.960255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ed80b0d-2262-4164-a39d-a86f2ef9b906 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:34.960797 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ed80b0d-2262-4164-a39d-a86f2ef9b906 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:34.961289 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ed80b0d-2262-4164-a39d-a86f2ef9b906 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:35.292706 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d9c185af-c5bf-495f-b83e-16e5f9d0f8e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:35.293309 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d9c185af-c5bf-495f-b83e-16e5f9d0f8e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:35.300093 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9c185af-c5bf-495f-b83e-16e5f9d0f8e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:35.300584 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9c185af-c5bf-495f-b83e-16e5f9d0f8e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:35.301010 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9c185af-c5bf-495f-b83e-16e5f9d0f8e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:35.301697 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9c185af-c5bf-495f-b83e-16e5f9d0f8e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:35.302154 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9c185af-c5bf-495f-b83e-16e5f9d0f8e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:35.302574 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9c185af-c5bf-495f-b83e-16e5f9d0f8e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:35.365591 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d9c185af-c5bf-495f-b83e-16e5f9d0f8e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:35.373809 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d9c185af-c5bf-495f-b83e-16e5f9d0f8e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1192 microversion: 2.1 time: 0.086102 Sep 13 03:26:35.374788 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 307/586] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:35 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:26:35.391630 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-1ed80b0d-2262-4164-a39d-a86f2ef9b906 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:35.399652 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-1ed80b0d-2262-4164-a39d-a86f2ef9b906 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:35.401097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-1ed80b0d-2262-4164-a39d-a86f2ef9b906 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:35.402260 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1ed80b0d-2262-4164-a39d-a86f2ef9b906 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1744 microversion: 2.20 time: 0.455918 Sep 13 03:26:35.402846 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 280/587] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:34 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1744 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:35.807150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-2b930dc0-5c80-4139-8f29-6e8cfeb24cb2 req-e61b9a12-9570-4dfa-97d7-f1ee21e85857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2620476c-6af0-419c-9d61-aeb1d1ee1457", "tag": "c759dcee-1328-4e27-8f62-118adab12265"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:35.818512 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2b930dc0-5c80-4139-8f29-6e8cfeb24cb2 req-e61b9a12-9570-4dfa-97d7-f1ee21e85857 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:35.819459 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2b930dc0-5c80-4139-8f29-6e8cfeb24cb2 req-e61b9a12-9570-4dfa-97d7-f1ee21e85857 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:35.819893 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2b930dc0-5c80-4139-8f29-6e8cfeb24cb2 req-e61b9a12-9570-4dfa-97d7-f1ee21e85857 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:35.832712 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-2b930dc0-5c80-4139-8f29-6e8cfeb24cb2 req-e61b9a12-9570-4dfa-97d7-f1ee21e85857 service nova] Creating event network-changed:c759dcee-1328-4e27-8f62-118adab12265 for instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 on hv-cinder-85707 Sep 13 03:26:35.839300 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-2b930dc0-5c80-4139-8f29-6e8cfeb24cb2 req-e61b9a12-9570-4dfa-97d7-f1ee21e85857 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183536 Sep 13 03:26:35.840995 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 308/588] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:26:36.397612 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a6ca9d84-a333-4367-8982-9c9190bcd3da tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:36.398357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a6ca9d84-a333-4367-8982-9c9190bcd3da tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:36.405699 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a6ca9d84-a333-4367-8982-9c9190bcd3da tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:36.406276 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a6ca9d84-a333-4367-8982-9c9190bcd3da tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:36.406750 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a6ca9d84-a333-4367-8982-9c9190bcd3da tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:36.407659 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a6ca9d84-a333-4367-8982-9c9190bcd3da tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:36.408271 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a6ca9d84-a333-4367-8982-9c9190bcd3da tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:36.408698 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a6ca9d84-a333-4367-8982-9c9190bcd3da tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:36.429383 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0f2b3196-5b9c-4e54-a77e-b7f8cb8f9b0d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:36.430829 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0f2b3196-5b9c-4e54-a77e-b7f8cb8f9b0d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:36.437731 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f2b3196-5b9c-4e54-a77e-b7f8cb8f9b0d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:36.438499 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f2b3196-5b9c-4e54-a77e-b7f8cb8f9b0d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:36.439356 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f2b3196-5b9c-4e54-a77e-b7f8cb8f9b0d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:36.440217 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f2b3196-5b9c-4e54-a77e-b7f8cb8f9b0d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:36.440829 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f2b3196-5b9c-4e54-a77e-b7f8cb8f9b0d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:36.441681 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f2b3196-5b9c-4e54-a77e-b7f8cb8f9b0d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:36.482318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a6ca9d84-a333-4367-8982-9c9190bcd3da tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:36.492284 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a6ca9d84-a333-4367-8982-9c9190bcd3da tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1210 microversion: 2.1 time: 0.098488 Sep 13 03:26:36.494649 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 281/589] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:36 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:36.794116 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0f2b3196-5b9c-4e54-a77e-b7f8cb8f9b0d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:36.804119 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0f2b3196-5b9c-4e54-a77e-b7f8cb8f9b0d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:36.808072 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0f2b3196-5b9c-4e54-a77e-b7f8cb8f9b0d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:36.810167 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0f2b3196-5b9c-4e54-a77e-b7f8cb8f9b0d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1744 microversion: 2.20 time: 0.385570 Sep 13 03:26:36.810769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 309/590] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:36 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1744 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:37.516164 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c3a55893-aab5-4be5-b7f4-32aebb75e029 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:37.516768 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c3a55893-aab5-4be5-b7f4-32aebb75e029 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:37.523194 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c3a55893-aab5-4be5-b7f4-32aebb75e029 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:37.523675 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c3a55893-aab5-4be5-b7f4-32aebb75e029 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:37.524105 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c3a55893-aab5-4be5-b7f4-32aebb75e029 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:37.524789 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c3a55893-aab5-4be5-b7f4-32aebb75e029 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:37.525234 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c3a55893-aab5-4be5-b7f4-32aebb75e029 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:37.525650 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c3a55893-aab5-4be5-b7f4-32aebb75e029 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:37.657715 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c3a55893-aab5-4be5-b7f4-32aebb75e029 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:37.665416 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c3a55893-aab5-4be5-b7f4-32aebb75e029 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.153095 Sep 13 03:26:37.666190 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 282/591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:37 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:37.835641 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7b54c6db-e04e-481b-8164-da38722a1113 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:37.836563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7b54c6db-e04e-481b-8164-da38722a1113 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:37.843956 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7b54c6db-e04e-481b-8164-da38722a1113 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:37.844445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7b54c6db-e04e-481b-8164-da38722a1113 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:37.844988 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7b54c6db-e04e-481b-8164-da38722a1113 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:37.845683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7b54c6db-e04e-481b-8164-da38722a1113 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:37.846135 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7b54c6db-e04e-481b-8164-da38722a1113 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:37.846710 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7b54c6db-e04e-481b-8164-da38722a1113 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:37.934199 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-21a5ece2-241b-4f05-b46c-cafb17456caf req-05e2b4bb-6425-4b2c-af7e-9302b612b2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4319ab9-e7a2-45ea-ae43-c9860ed33cef", "tag": "b5169432-a539-41f3-a735-e6f12d3f1fbc"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:37.943935 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-21a5ece2-241b-4f05-b46c-cafb17456caf req-05e2b4bb-6425-4b2c-af7e-9302b612b2e6 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:37.944425 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-21a5ece2-241b-4f05-b46c-cafb17456caf req-05e2b4bb-6425-4b2c-af7e-9302b612b2e6 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:37.944849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-21a5ece2-241b-4f05-b46c-cafb17456caf req-05e2b4bb-6425-4b2c-af7e-9302b612b2e6 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:37.956232 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-21a5ece2-241b-4f05-b46c-cafb17456caf req-05e2b4bb-6425-4b2c-af7e-9302b612b2e6 service nova] Creating event network-changed:b5169432-a539-41f3-a735-e6f12d3f1fbc for instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef on hv-cinder-85707 Sep 13 03:26:37.961103 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-21a5ece2-241b-4f05-b46c-cafb17456caf req-05e2b4bb-6425-4b2c-af7e-9302b612b2e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114780 Sep 13 03:26:37.961940 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 283/592] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:26:38.025512 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7b54c6db-e04e-481b-8164-da38722a1113 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:38.035228 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7b54c6db-e04e-481b-8164-da38722a1113 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:38.036757 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7b54c6db-e04e-481b-8164-da38722a1113 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:38.037959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7b54c6db-e04e-481b-8164-da38722a1113 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1744 microversion: 2.20 time: 0.206214 Sep 13 03:26:38.038524 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 310/593] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:37 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1744 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:38.690081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-21574b3c-f3c3-4b24-a2ca-216297f2183d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:38.690932 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-21574b3c-f3c3-4b24-a2ca-216297f2183d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:38.697188 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-21574b3c-f3c3-4b24-a2ca-216297f2183d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:38.697789 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-21574b3c-f3c3-4b24-a2ca-216297f2183d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:38.698329 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-21574b3c-f3c3-4b24-a2ca-216297f2183d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:38.699164 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-21574b3c-f3c3-4b24-a2ca-216297f2183d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:38.700242 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-21574b3c-f3c3-4b24-a2ca-216297f2183d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:38.700761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-21574b3c-f3c3-4b24-a2ca-216297f2183d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:38.842700 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-21574b3c-f3c3-4b24-a2ca-216297f2183d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:38.850366 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-21574b3c-f3c3-4b24-a2ca-216297f2183d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.165045 Sep 13 03:26:38.851185 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 284/594] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:38 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:39.063544 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-665fabb3-bdc9-42c8-8687-979db11737f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:39.064775 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-665fabb3-bdc9-42c8-8687-979db11737f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:39.071380 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-665fabb3-bdc9-42c8-8687-979db11737f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:39.071873 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-665fabb3-bdc9-42c8-8687-979db11737f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:39.072317 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-665fabb3-bdc9-42c8-8687-979db11737f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:39.073014 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-665fabb3-bdc9-42c8-8687-979db11737f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:39.073470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-665fabb3-bdc9-42c8-8687-979db11737f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:39.073900 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-665fabb3-bdc9-42c8-8687-979db11737f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:39.215914 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-665fabb3-bdc9-42c8-8687-979db11737f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:39.225360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-665fabb3-bdc9-42c8-8687-979db11737f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:39.226825 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-665fabb3-bdc9-42c8-8687-979db11737f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:39.228178 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-665fabb3-bdc9-42c8-8687-979db11737f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1739 microversion: 2.20 time: 0.169220 Sep 13 03:26:39.242640 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 311/595] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:39 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:39.874728 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1475a37f-7359-436b-85bf-b7e9db8b5f53 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:39.876249 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-1475a37f-7359-436b-85bf-b7e9db8b5f53 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:39.883890 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1475a37f-7359-436b-85bf-b7e9db8b5f53 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:39.884544 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1475a37f-7359-436b-85bf-b7e9db8b5f53 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:39.884873 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1475a37f-7359-436b-85bf-b7e9db8b5f53 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:39.885663 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1475a37f-7359-436b-85bf-b7e9db8b5f53 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:39.886341 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1475a37f-7359-436b-85bf-b7e9db8b5f53 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:39.886856 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1475a37f-7359-436b-85bf-b7e9db8b5f53 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:40.031690 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-1475a37f-7359-436b-85bf-b7e9db8b5f53 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:40.041183 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1475a37f-7359-436b-85bf-b7e9db8b5f53 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.170802 Sep 13 03:26:40.042304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 285/596] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:39 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:40.259634 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-76c1bcc6-859e-4e55-b2f5-298ebd4ec75c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:40.260248 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-76c1bcc6-859e-4e55-b2f5-298ebd4ec75c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:40.268995 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76c1bcc6-859e-4e55-b2f5-298ebd4ec75c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:40.270280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76c1bcc6-859e-4e55-b2f5-298ebd4ec75c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:40.270750 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76c1bcc6-859e-4e55-b2f5-298ebd4ec75c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:40.271648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76c1bcc6-859e-4e55-b2f5-298ebd4ec75c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:40.272105 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76c1bcc6-859e-4e55-b2f5-298ebd4ec75c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:40.272535 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76c1bcc6-859e-4e55-b2f5-298ebd4ec75c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:40.463057 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-76c1bcc6-859e-4e55-b2f5-298ebd4ec75c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:40.473394 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-76c1bcc6-859e-4e55-b2f5-298ebd4ec75c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:40.475277 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-76c1bcc6-859e-4e55-b2f5-298ebd4ec75c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:40.476492 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-76c1bcc6-859e-4e55-b2f5-298ebd4ec75c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1739 microversion: 2.20 time: 0.220811 Sep 13 03:26:40.477217 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 312/597] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:40 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:41.065015 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a77941f8-db4a-4aaa-a5d8-ffba0a7ce75f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:41.066371 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a77941f8-db4a-4aaa-a5d8-ffba0a7ce75f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:41.074290 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a77941f8-db4a-4aaa-a5d8-ffba0a7ce75f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:41.075148 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a77941f8-db4a-4aaa-a5d8-ffba0a7ce75f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:41.075872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a77941f8-db4a-4aaa-a5d8-ffba0a7ce75f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:41.076785 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a77941f8-db4a-4aaa-a5d8-ffba0a7ce75f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:41.077429 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a77941f8-db4a-4aaa-a5d8-ffba0a7ce75f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:41.078111 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a77941f8-db4a-4aaa-a5d8-ffba0a7ce75f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:41.244420 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a77941f8-db4a-4aaa-a5d8-ffba0a7ce75f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:41.264217 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a77941f8-db4a-4aaa-a5d8-ffba0a7ce75f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.202925 Sep 13 03:26:41.264900 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 286/598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:41 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:26:41.502926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7441be45-e563-43e0-b67c-6653b1ceb7b5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:41.504460 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7441be45-e563-43e0-b67c-6653b1ceb7b5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:41.513079 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7441be45-e563-43e0-b67c-6653b1ceb7b5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:41.515438 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7441be45-e563-43e0-b67c-6653b1ceb7b5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:41.516108 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7441be45-e563-43e0-b67c-6653b1ceb7b5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:41.517059 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7441be45-e563-43e0-b67c-6653b1ceb7b5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:41.517926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7441be45-e563-43e0-b67c-6653b1ceb7b5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:41.518426 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7441be45-e563-43e0-b67c-6653b1ceb7b5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:41.677064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7441be45-e563-43e0-b67c-6653b1ceb7b5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:41.686864 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7441be45-e563-43e0-b67c-6653b1ceb7b5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:41.688447 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7441be45-e563-43e0-b67c-6653b1ceb7b5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:41.689773 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7441be45-e563-43e0-b67c-6653b1ceb7b5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1739 microversion: 2.20 time: 0.192131 Sep 13 03:26:41.690910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 313/599] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:41 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:42.292548 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ab545470-4444-492f-8ea5-eeb1b0432ffa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:42.292548 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ab545470-4444-492f-8ea5-eeb1b0432ffa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:42.299767 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab545470-4444-492f-8ea5-eeb1b0432ffa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:42.300258 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab545470-4444-492f-8ea5-eeb1b0432ffa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:42.300693 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab545470-4444-492f-8ea5-eeb1b0432ffa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:42.301391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab545470-4444-492f-8ea5-eeb1b0432ffa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:42.301845 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab545470-4444-492f-8ea5-eeb1b0432ffa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:42.302266 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab545470-4444-492f-8ea5-eeb1b0432ffa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:42.447951 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ab545470-4444-492f-8ea5-eeb1b0432ffa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:42.457646 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ab545470-4444-492f-8ea5-eeb1b0432ffa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.170043 Sep 13 03:26:42.458571 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 287/600] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:42 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:42.719354 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-08df6a65-603a-44ff-a141-2dc6f20c1e07 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:42.719970 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-08df6a65-603a-44ff-a141-2dc6f20c1e07 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:42.722416 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=62 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:42.728246 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-08df6a65-603a-44ff-a141-2dc6f20c1e07 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:42.728983 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-08df6a65-603a-44ff-a141-2dc6f20c1e07 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:42.729463 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-08df6a65-603a-44ff-a141-2dc6f20c1e07 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:42.730167 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-08df6a65-603a-44ff-a141-2dc6f20c1e07 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:42.730650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-08df6a65-603a-44ff-a141-2dc6f20c1e07 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:42.731626 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-08df6a65-603a-44ff-a141-2dc6f20c1e07 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:42.881708 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-08df6a65-603a-44ff-a141-2dc6f20c1e07 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:42.894112 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-08df6a65-603a-44ff-a141-2dc6f20c1e07 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:42.897357 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-08df6a65-603a-44ff-a141-2dc6f20c1e07 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:42.898593 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-08df6a65-603a-44ff-a141-2dc6f20c1e07 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1739 microversion: 2.20 time: 0.186240 Sep 13 03:26:42.910820 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 314/601] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:42 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:43.481202 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-81e5f2b8-3326-41aa-9bd1-a13a76cbbbc4 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:43.481819 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-81e5f2b8-3326-41aa-9bd1-a13a76cbbbc4 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:43.484255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:43.489416 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81e5f2b8-3326-41aa-9bd1-a13a76cbbbc4 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:43.489904 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81e5f2b8-3326-41aa-9bd1-a13a76cbbbc4 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:43.490360 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81e5f2b8-3326-41aa-9bd1-a13a76cbbbc4 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:43.491060 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81e5f2b8-3326-41aa-9bd1-a13a76cbbbc4 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:43.491515 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81e5f2b8-3326-41aa-9bd1-a13a76cbbbc4 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:43.491938 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81e5f2b8-3326-41aa-9bd1-a13a76cbbbc4 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:43.632926 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-81e5f2b8-3326-41aa-9bd1-a13a76cbbbc4 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:43.642019 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-81e5f2b8-3326-41aa-9bd1-a13a76cbbbc4 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.164687 Sep 13 03:26:43.647156 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 288/602] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:43 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:43.925865 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-15226461-10e7-4385-9ec2-d31f45b4f1b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:43.926559 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-15226461-10e7-4385-9ec2-d31f45b4f1b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:43.933604 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-15226461-10e7-4385-9ec2-d31f45b4f1b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:43.934915 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-15226461-10e7-4385-9ec2-d31f45b4f1b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:43.935589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-15226461-10e7-4385-9ec2-d31f45b4f1b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:43.936524 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-15226461-10e7-4385-9ec2-d31f45b4f1b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:43.937182 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-15226461-10e7-4385-9ec2-d31f45b4f1b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:43.937845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-15226461-10e7-4385-9ec2-d31f45b4f1b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:44.078280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-15226461-10e7-4385-9ec2-d31f45b4f1b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:44.087038 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-15226461-10e7-4385-9ec2-d31f45b4f1b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:44.088685 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-15226461-10e7-4385-9ec2-d31f45b4f1b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:44.089835 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-15226461-10e7-4385-9ec2-d31f45b4f1b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1739 microversion: 2.20 time: 0.168177 Sep 13 03:26:44.091123 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 315/603] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:43 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:44.664949 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-50be9b1f-87b7-4506-8272-ac1c3f233823 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:44.670354 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-50be9b1f-87b7-4506-8272-ac1c3f233823 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:44.674045 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:44.674855 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=8 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:44.681268 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50be9b1f-87b7-4506-8272-ac1c3f233823 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:44.681870 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50be9b1f-87b7-4506-8272-ac1c3f233823 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:44.682475 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50be9b1f-87b7-4506-8272-ac1c3f233823 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:44.686123 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50be9b1f-87b7-4506-8272-ac1c3f233823 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:44.686843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50be9b1f-87b7-4506-8272-ac1c3f233823 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:44.687279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-50be9b1f-87b7-4506-8272-ac1c3f233823 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:44.838519 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-50be9b1f-87b7-4506-8272-ac1c3f233823 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:44.846975 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-50be9b1f-87b7-4506-8272-ac1c3f233823 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.186536 Sep 13 03:26:44.847671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 289/604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:44 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:45.129747 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-acd84f08-40eb-41dd-b796-d9fdc600d1b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:45.130363 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-acd84f08-40eb-41dd-b796-d9fdc600d1b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:45.139900 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-acd84f08-40eb-41dd-b796-d9fdc600d1b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:45.140645 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-acd84f08-40eb-41dd-b796-d9fdc600d1b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:45.141390 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-acd84f08-40eb-41dd-b796-d9fdc600d1b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:45.142454 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-acd84f08-40eb-41dd-b796-d9fdc600d1b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:45.143391 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-acd84f08-40eb-41dd-b796-d9fdc600d1b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:45.144086 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-acd84f08-40eb-41dd-b796-d9fdc600d1b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:45.319360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-acd84f08-40eb-41dd-b796-d9fdc600d1b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:45.328522 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-acd84f08-40eb-41dd-b796-d9fdc600d1b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:45.330357 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-acd84f08-40eb-41dd-b796-d9fdc600d1b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:45.331625 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-acd84f08-40eb-41dd-b796-d9fdc600d1b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1739 microversion: 2.20 time: 0.214824 Sep 13 03:26:45.332189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 316/605] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:45 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:45.871052 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a6ff6777-7b02-452b-8275-fa9f3ab6ae7b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:45.872371 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a6ff6777-7b02-452b-8275-fa9f3ab6ae7b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:45.879681 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a6ff6777-7b02-452b-8275-fa9f3ab6ae7b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:45.880157 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a6ff6777-7b02-452b-8275-fa9f3ab6ae7b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:45.881035 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a6ff6777-7b02-452b-8275-fa9f3ab6ae7b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:45.881875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a6ff6777-7b02-452b-8275-fa9f3ab6ae7b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:45.882506 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a6ff6777-7b02-452b-8275-fa9f3ab6ae7b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:45.882945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a6ff6777-7b02-452b-8275-fa9f3ab6ae7b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:46.024689 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a6ff6777-7b02-452b-8275-fa9f3ab6ae7b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:46.033577 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a6ff6777-7b02-452b-8275-fa9f3ab6ae7b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.166309 Sep 13 03:26:46.034410 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 290/606] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:45 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:46.363069 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2a1d164c-fead-4b81-9634-d17efcf3fe9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:46.364329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2a1d164c-fead-4b81-9634-d17efcf3fe9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:46.370663 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a1d164c-fead-4b81-9634-d17efcf3fe9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:46.372023 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a1d164c-fead-4b81-9634-d17efcf3fe9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:46.372824 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a1d164c-fead-4b81-9634-d17efcf3fe9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:46.373926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a1d164c-fead-4b81-9634-d17efcf3fe9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:46.374658 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a1d164c-fead-4b81-9634-d17efcf3fe9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:46.375353 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a1d164c-fead-4b81-9634-d17efcf3fe9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:46.508871 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2a1d164c-fead-4b81-9634-d17efcf3fe9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:46.512363 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:46.517346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2a1d164c-fead-4b81-9634-d17efcf3fe9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:46.518816 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2a1d164c-fead-4b81-9634-d17efcf3fe9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:46.519981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2a1d164c-fead-4b81-9634-d17efcf3fe9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1739 microversion: 2.20 time: 0.160805 Sep 13 03:26:46.534632 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 317/607] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:46 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:47.071457 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b4af56e3-018d-4429-9350-c84410b4598c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:47.073928 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b4af56e3-018d-4429-9350-c84410b4598c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:47.103704 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b4af56e3-018d-4429-9350-c84410b4598c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:47.104387 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b4af56e3-018d-4429-9350-c84410b4598c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:47.104997 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b4af56e3-018d-4429-9350-c84410b4598c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:47.106450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b4af56e3-018d-4429-9350-c84410b4598c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:47.107078 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b4af56e3-018d-4429-9350-c84410b4598c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:47.107648 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b4af56e3-018d-4429-9350-c84410b4598c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:47.255122 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b4af56e3-018d-4429-9350-c84410b4598c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:47.263849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b4af56e3-018d-4429-9350-c84410b4598c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.205861 Sep 13 03:26:47.269776 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 291/608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:47 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:47.546885 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-545f33b1-e3c1-4238-87db-bb74f0ccba0f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:47.549348 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-545f33b1-e3c1-4238-87db-bb74f0ccba0f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:47.559630 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-545f33b1-e3c1-4238-87db-bb74f0ccba0f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:47.560510 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-545f33b1-e3c1-4238-87db-bb74f0ccba0f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:47.561028 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-545f33b1-e3c1-4238-87db-bb74f0ccba0f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:47.562237 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-545f33b1-e3c1-4238-87db-bb74f0ccba0f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:47.563467 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-545f33b1-e3c1-4238-87db-bb74f0ccba0f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:47.563910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-545f33b1-e3c1-4238-87db-bb74f0ccba0f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:47.722250 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-545f33b1-e3c1-4238-87db-bb74f0ccba0f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:47.739507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-545f33b1-e3c1-4238-87db-bb74f0ccba0f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:47.741499 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-545f33b1-e3c1-4238-87db-bb74f0ccba0f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:47.743225 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-545f33b1-e3c1-4238-87db-bb74f0ccba0f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1739 microversion: 2.20 time: 0.200916 Sep 13 03:26:47.744074 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 318/609] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:47 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:48.292174 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f36b482d-34e3-437f-8031-57842309e286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:48.293029 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f36b482d-34e3-437f-8031-57842309e286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:48.300241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f36b482d-34e3-437f-8031-57842309e286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:48.300473 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f36b482d-34e3-437f-8031-57842309e286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:48.300873 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f36b482d-34e3-437f-8031-57842309e286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:48.301586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f36b482d-34e3-437f-8031-57842309e286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:48.302032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f36b482d-34e3-437f-8031-57842309e286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:48.302452 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f36b482d-34e3-437f-8031-57842309e286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:48.463329 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f36b482d-34e3-437f-8031-57842309e286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:48.471243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f36b482d-34e3-437f-8031-57842309e286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.183598 Sep 13 03:26:48.471821 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 292/610] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:48 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:48.768516 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2bbce4fa-de17-4829-a515-c9e83cea86c6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:48.769151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2bbce4fa-de17-4829-a515-c9e83cea86c6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:48.776171 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2bbce4fa-de17-4829-a515-c9e83cea86c6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:48.776807 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2bbce4fa-de17-4829-a515-c9e83cea86c6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:48.778173 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2bbce4fa-de17-4829-a515-c9e83cea86c6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:48.779777 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2bbce4fa-de17-4829-a515-c9e83cea86c6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:48.780724 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2bbce4fa-de17-4829-a515-c9e83cea86c6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:48.781450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2bbce4fa-de17-4829-a515-c9e83cea86c6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:48.939820 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2bbce4fa-de17-4829-a515-c9e83cea86c6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:48.951431 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2bbce4fa-de17-4829-a515-c9e83cea86c6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:48.952753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2bbce4fa-de17-4829-a515-c9e83cea86c6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:48.953999 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2bbce4fa-de17-4829-a515-c9e83cea86c6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1739 microversion: 2.20 time: 0.189427 Sep 13 03:26:48.955253 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 319/611] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:48 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:49.494961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f7b7ed66-db44-419a-866a-a993c3c8045b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:49.495570 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f7b7ed66-db44-419a-866a-a993c3c8045b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:49.502303 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7b7ed66-db44-419a-866a-a993c3c8045b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:49.502821 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7b7ed66-db44-419a-866a-a993c3c8045b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:49.503251 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7b7ed66-db44-419a-866a-a993c3c8045b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:49.503932 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7b7ed66-db44-419a-866a-a993c3c8045b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:49.504379 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7b7ed66-db44-419a-866a-a993c3c8045b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:49.504795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7b7ed66-db44-419a-866a-a993c3c8045b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:49.639083 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f7b7ed66-db44-419a-866a-a993c3c8045b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:49.642409 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=100 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:49.647364 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f7b7ed66-db44-419a-866a-a993c3c8045b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.156243 Sep 13 03:26:49.647925 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 293/612] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:49 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:49.979922 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f20289b8-ddfb-4164-bc0b-8a3800e522ab tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:49.980534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f20289b8-ddfb-4164-bc0b-8a3800e522ab tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:49.986880 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f20289b8-ddfb-4164-bc0b-8a3800e522ab tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:49.987363 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f20289b8-ddfb-4164-bc0b-8a3800e522ab tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:49.987798 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f20289b8-ddfb-4164-bc0b-8a3800e522ab tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:49.988487 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f20289b8-ddfb-4164-bc0b-8a3800e522ab tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:49.988942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f20289b8-ddfb-4164-bc0b-8a3800e522ab tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:49.989368 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f20289b8-ddfb-4164-bc0b-8a3800e522ab tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:50.119092 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f20289b8-ddfb-4164-bc0b-8a3800e522ab tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:50.127621 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f20289b8-ddfb-4164-bc0b-8a3800e522ab tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:50.129058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f20289b8-ddfb-4164-bc0b-8a3800e522ab tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:50.130208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f20289b8-ddfb-4164-bc0b-8a3800e522ab tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1739 microversion: 2.20 time: 0.154421 Sep 13 03:26:50.130787 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 320/613] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:49 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:50.670450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-940440eb-6a41-4b01-a1ff-5a61b18f53c2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:50.671093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-940440eb-6a41-4b01-a1ff-5a61b18f53c2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:50.677763 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-940440eb-6a41-4b01-a1ff-5a61b18f53c2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:50.678254 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-940440eb-6a41-4b01-a1ff-5a61b18f53c2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:50.678731 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-940440eb-6a41-4b01-a1ff-5a61b18f53c2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:50.679430 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-940440eb-6a41-4b01-a1ff-5a61b18f53c2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:50.679887 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-940440eb-6a41-4b01-a1ff-5a61b18f53c2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:50.680313 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-940440eb-6a41-4b01-a1ff-5a61b18f53c2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:50.809632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-940440eb-6a41-4b01-a1ff-5a61b18f53c2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:50.817311 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-940440eb-6a41-4b01-a1ff-5a61b18f53c2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.150999 Sep 13 03:26:50.817885 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 294/614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:50 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:51.156136 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0439e136-7240-42e3-a46e-3e99de8625c0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:51.156779 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0439e136-7240-42e3-a46e-3e99de8625c0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:51.163203 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0439e136-7240-42e3-a46e-3e99de8625c0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:51.163710 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0439e136-7240-42e3-a46e-3e99de8625c0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:51.164343 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0439e136-7240-42e3-a46e-3e99de8625c0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:51.165216 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0439e136-7240-42e3-a46e-3e99de8625c0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:51.165821 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0439e136-7240-42e3-a46e-3e99de8625c0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:51.166762 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0439e136-7240-42e3-a46e-3e99de8625c0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:51.308141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0439e136-7240-42e3-a46e-3e99de8625c0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:51.314367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-32e9f31b-36d1-4cbb-8841-9d3e00192972 req-81cbc05c-5fa2-4d51-8ce1-b423ff451702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4319ab9-e7a2-45ea-ae43-c9860ed33cef", "name": "network-vif-plugged", "status": "completed", "tag": "b5169432-a539-41f3-a735-e6f12d3f1fbc"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:51.318100 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0439e136-7240-42e3-a46e-3e99de8625c0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:51.319587 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0439e136-7240-42e3-a46e-3e99de8625c0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:51.320746 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0439e136-7240-42e3-a46e-3e99de8625c0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1721 microversion: 2.20 time: 0.168993 Sep 13 03:26:51.321295 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 321/615] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:51 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:51.324663 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-32e9f31b-36d1-4cbb-8841-9d3e00192972 req-81cbc05c-5fa2-4d51-8ce1-b423ff451702 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:51.326421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-32e9f31b-36d1-4cbb-8841-9d3e00192972 req-81cbc05c-5fa2-4d51-8ce1-b423ff451702 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:51.326897 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-32e9f31b-36d1-4cbb-8841-9d3e00192972 req-81cbc05c-5fa2-4d51-8ce1-b423ff451702 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:51.337674 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-32e9f31b-36d1-4cbb-8841-9d3e00192972 req-81cbc05c-5fa2-4d51-8ce1-b423ff451702 service nova] Creating event network-vif-plugged:b5169432-a539-41f3-a735-e6f12d3f1fbc for instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef on hv-cinder-85707 Sep 13 03:26:51.342754 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-32e9f31b-36d1-4cbb-8841-9d3e00192972 req-81cbc05c-5fa2-4d51-8ce1-b423ff451702 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097779 Sep 13 03:26:51.343342 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 295/616] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:26:51.840967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-736c9c38-b95c-43c5-9ed5-f9b923921749 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:51.841578 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-736c9c38-b95c-43c5-9ed5-f9b923921749 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:51.847551 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-736c9c38-b95c-43c5-9ed5-f9b923921749 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:51.848036 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-736c9c38-b95c-43c5-9ed5-f9b923921749 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:51.848474 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-736c9c38-b95c-43c5-9ed5-f9b923921749 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:51.849157 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-736c9c38-b95c-43c5-9ed5-f9b923921749 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:51.849611 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-736c9c38-b95c-43c5-9ed5-f9b923921749 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:51.850033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-736c9c38-b95c-43c5-9ed5-f9b923921749 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:51.976327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-736c9c38-b95c-43c5-9ed5-f9b923921749 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:51.984478 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-736c9c38-b95c-43c5-9ed5-f9b923921749 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.147427 Sep 13 03:26:51.985046 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 322/617] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:51 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:52.346879 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-94108b0d-77d9-4d31-909d-d19b68e0e2e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:52.347576 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-94108b0d-77d9-4d31-909d-d19b68e0e2e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:52.353667 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-94108b0d-77d9-4d31-909d-d19b68e0e2e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:52.354150 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-94108b0d-77d9-4d31-909d-d19b68e0e2e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:52.354588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-94108b0d-77d9-4d31-909d-d19b68e0e2e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:52.355298 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-94108b0d-77d9-4d31-909d-d19b68e0e2e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:52.356413 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-94108b0d-77d9-4d31-909d-d19b68e0e2e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:52.356837 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-94108b0d-77d9-4d31-909d-d19b68e0e2e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:52.486693 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-94108b0d-77d9-4d31-909d-d19b68e0e2e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:52.494700 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-94108b0d-77d9-4d31-909d-d19b68e0e2e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:52.496124 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-94108b0d-77d9-4d31-909d-d19b68e0e2e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:52.497266 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-94108b0d-77d9-4d31-909d-d19b68e0e2e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1721 microversion: 2.20 time: 0.155181 Sep 13 03:26:52.497824 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 296/618] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:52 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:53.006958 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-575c34ec-41a0-4339-8ed0-86aa29dabc08 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:53.007569 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-575c34ec-41a0-4339-8ed0-86aa29dabc08 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:53.014599 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-575c34ec-41a0-4339-8ed0-86aa29dabc08 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:53.015110 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-575c34ec-41a0-4339-8ed0-86aa29dabc08 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:53.015543 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-575c34ec-41a0-4339-8ed0-86aa29dabc08 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:53.016222 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-575c34ec-41a0-4339-8ed0-86aa29dabc08 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:53.016673 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-575c34ec-41a0-4339-8ed0-86aa29dabc08 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:53.017096 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-575c34ec-41a0-4339-8ed0-86aa29dabc08 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:53.149273 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-575c34ec-41a0-4339-8ed0-86aa29dabc08 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:53.157456 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-575c34ec-41a0-4339-8ed0-86aa29dabc08 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.154364 Sep 13 03:26:53.158023 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 323/619] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:53 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:53.522190 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-900512e0-ed52-400e-8189-9e4692066705 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:53.522818 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-900512e0-ed52-400e-8189-9e4692066705 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:53.529178 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-900512e0-ed52-400e-8189-9e4692066705 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:53.529657 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-900512e0-ed52-400e-8189-9e4692066705 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:53.530087 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-900512e0-ed52-400e-8189-9e4692066705 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:53.530797 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-900512e0-ed52-400e-8189-9e4692066705 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:53.531246 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-900512e0-ed52-400e-8189-9e4692066705 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:53.531708 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-900512e0-ed52-400e-8189-9e4692066705 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:53.657483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-900512e0-ed52-400e-8189-9e4692066705 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:53.665559 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-900512e0-ed52-400e-8189-9e4692066705 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:53.667306 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-900512e0-ed52-400e-8189-9e4692066705 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:53.668968 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-900512e0-ed52-400e-8189-9e4692066705 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1724 microversion: 2.20 time: 0.150671 Sep 13 03:26:53.669530 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 297/620] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:53 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:53.693492 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e8c44e8e-9a4e-41b1-b501-89a2dd9b651a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0ec7061-20f5-4673-accb-4045a1c9ab67"}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:53.695912 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e8c44e8e-9a4e-41b1-b501-89a2dd9b651a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:53.702297 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e8c44e8e-9a4e-41b1-b501-89a2dd9b651a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:53.702819 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e8c44e8e-9a4e-41b1-b501-89a2dd9b651a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:53.703256 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e8c44e8e-9a4e-41b1-b501-89a2dd9b651a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:53.703937 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e8c44e8e-9a4e-41b1-b501-89a2dd9b651a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:53.704390 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e8c44e8e-9a4e-41b1-b501-89a2dd9b651a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:53.704813 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e8c44e8e-9a4e-41b1-b501-89a2dd9b651a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:53.982053 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e8c44e8e-9a4e-41b1-b501-89a2dd9b651a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "POST /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292525 Sep 13 03:26:53.988059 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 324/621] 10.222.0.18 () {62 vars in 1364 bytes} [Tue Sep 13 03:26:53 2022] POST /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:26:54.106689 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-758a7341-a03f-47d9-8b2a-031cf68a5fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:54.107282 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-758a7341-a03f-47d9-8b2a-031cf68a5fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:54.113081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-758a7341-a03f-47d9-8b2a-031cf68a5fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:54.113567 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-758a7341-a03f-47d9-8b2a-031cf68a5fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:54.114003 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-758a7341-a03f-47d9-8b2a-031cf68a5fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:54.114714 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-758a7341-a03f-47d9-8b2a-031cf68a5fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:54.115167 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-758a7341-a03f-47d9-8b2a-031cf68a5fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:54.115589 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-758a7341-a03f-47d9-8b2a-031cf68a5fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:54.157305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-758a7341-a03f-47d9-8b2a-031cf68a5fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120384) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 03:26:54.180190 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f2c6ff18-de41-4fca-b766-42dfc97d9d60 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:54.180943 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f2c6ff18-de41-4fca-b766-42dfc97d9d60 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:54.188434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2c6ff18-de41-4fca-b766-42dfc97d9d60 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:54.188923 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2c6ff18-de41-4fca-b766-42dfc97d9d60 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:54.189356 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2c6ff18-de41-4fca-b766-42dfc97d9d60 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:54.190045 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2c6ff18-de41-4fca-b766-42dfc97d9d60 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:54.190494 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2c6ff18-de41-4fca-b766-42dfc97d9d60 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:54.190949 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2c6ff18-de41-4fca-b766-42dfc97d9d60 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:54.227528 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-758a7341-a03f-47d9-8b2a-031cf68a5fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "POST /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/action" status: 202 len: 0 microversion: 2.20 time: 0.124300 Sep 13 03:26:54.228134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 298/622] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Sep 13 03:26:54 2022] POST /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:26:54.236585 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-bc1ecac2-f9fb-456f-8e5c-a7145ec250de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:54.237171 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-bc1ecac2-f9fb-456f-8e5c-a7145ec250de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:54.243521 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc1ecac2-f9fb-456f-8e5c-a7145ec250de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:54.244004 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc1ecac2-f9fb-456f-8e5c-a7145ec250de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:54.244433 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc1ecac2-f9fb-456f-8e5c-a7145ec250de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:54.245129 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc1ecac2-f9fb-456f-8e5c-a7145ec250de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:54.245570 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc1ecac2-f9fb-456f-8e5c-a7145ec250de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:54.245987 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc1ecac2-f9fb-456f-8e5c-a7145ec250de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:54.334595 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f2c6ff18-de41-4fca-b766-42dfc97d9d60 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:54.342530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f2c6ff18-de41-4fca-b766-42dfc97d9d60 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1266 microversion: 2.1 time: 0.166185 Sep 13 03:26:54.343238 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 325/623] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:54 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:26:54.392775 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-bc1ecac2-f9fb-456f-8e5c-a7145ec250de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:54.402176 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-bc1ecac2-f9fb-456f-8e5c-a7145ec250de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:54.403749 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-bc1ecac2-f9fb-456f-8e5c-a7145ec250de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:54.404898 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-bc1ecac2-f9fb-456f-8e5c-a7145ec250de tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1810 microversion: 2.20 time: 0.172148 Sep 13 03:26:54.405455 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 299/624] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:54 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:26:55.219268 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-28e6cc96-2b04-4396-a0d1-28459b950490 req-eb3f29c1-684a-463a-b181-0573f1f272f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97f011a-6370-474e-9a62-e9229eb7d7ee", "name": "network-vif-unplugged", "status": "completed", "tag": "1c922edb-7dd6-4a91-ba67-004272056f1c"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:55.231990 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-28e6cc96-2b04-4396-a0d1-28459b950490 req-eb3f29c1-684a-463a-b181-0573f1f272f3 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:55.232477 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-28e6cc96-2b04-4396-a0d1-28459b950490 req-eb3f29c1-684a-463a-b181-0573f1f272f3 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:55.232910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-28e6cc96-2b04-4396-a0d1-28459b950490 req-eb3f29c1-684a-463a-b181-0573f1f272f3 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:55.244098 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.compute.server_external_events [req-28e6cc96-2b04-4396-a0d1-28459b950490 req-eb3f29c1-684a-463a-b181-0573f1f272f3 service nova] Unable to find a host for instance a97f011a-6370-474e-9a62-e9229eb7d7ee. Dropping event network-vif-unplugged {{(pid=120383) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 03:26:55.244978 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-28e6cc96-2b04-4396-a0d1-28459b950490 req-eb3f29c1-684a-463a-b181-0573f1f272f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035311 Sep 13 03:26:55.245557 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 326/625] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 13 03:26:55.365086 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-24e7e3b1-4f5a-4c0d-afe3-ff5ba732b7d6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:55.365759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-24e7e3b1-4f5a-4c0d-afe3-ff5ba732b7d6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:55.373486 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-24e7e3b1-4f5a-4c0d-afe3-ff5ba732b7d6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:55.374061 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-24e7e3b1-4f5a-4c0d-afe3-ff5ba732b7d6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:55.374563 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-24e7e3b1-4f5a-4c0d-afe3-ff5ba732b7d6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:55.375287 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-24e7e3b1-4f5a-4c0d-afe3-ff5ba732b7d6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:55.375740 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-24e7e3b1-4f5a-4c0d-afe3-ff5ba732b7d6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:55.376160 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-24e7e3b1-4f5a-4c0d-afe3-ff5ba732b7d6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:55.430465 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cf80de59-e454-4a66-bd13-2ad0d8ccb84f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:55.431138 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-cf80de59-e454-4a66-bd13-2ad0d8ccb84f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:55.437615 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf80de59-e454-4a66-bd13-2ad0d8ccb84f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:55.438100 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf80de59-e454-4a66-bd13-2ad0d8ccb84f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:55.438539 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf80de59-e454-4a66-bd13-2ad0d8ccb84f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:55.439268 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf80de59-e454-4a66-bd13-2ad0d8ccb84f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:55.439721 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf80de59-e454-4a66-bd13-2ad0d8ccb84f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:55.440162 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf80de59-e454-4a66-bd13-2ad0d8ccb84f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:55.514041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-24e7e3b1-4f5a-4c0d-afe3-ff5ba732b7d6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:55.522209 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-24e7e3b1-4f5a-4c0d-afe3-ff5ba732b7d6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1452 microversion: 2.1 time: 0.160788 Sep 13 03:26:55.522971 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 300/626] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:55 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:26:55.544456 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-41662580-aa98-4a4f-9dce-33ee4374dcb5 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:55.545072 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-41662580-aa98-4a4f-9dce-33ee4374dcb5 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:55.551133 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-41662580-aa98-4a4f-9dce-33ee4374dcb5 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:55.551616 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-41662580-aa98-4a4f-9dce-33ee4374dcb5 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:55.552044 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-41662580-aa98-4a4f-9dce-33ee4374dcb5 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:55.552726 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-41662580-aa98-4a4f-9dce-33ee4374dcb5 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:55.553174 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-41662580-aa98-4a4f-9dce-33ee4374dcb5 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:55.553592 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-41662580-aa98-4a4f-9dce-33ee4374dcb5 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:55.575773 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-cf80de59-e454-4a66-bd13-2ad0d8ccb84f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:55.584398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-cf80de59-e454-4a66-bd13-2ad0d8ccb84f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:55.585754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-cf80de59-e454-4a66-bd13-2ad0d8ccb84f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:55.586933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-cf80de59-e454-4a66-bd13-2ad0d8ccb84f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1752 microversion: 2.20 time: 0.160468 Sep 13 03:26:55.587483 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 327/627] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:55 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:26:55.687875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-41662580-aa98-4a4f-9dce-33ee4374dcb5 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:55.695469 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-41662580-aa98-4a4f-9dce-33ee4374dcb5 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1452 microversion: 2.1 time: 0.155009 Sep 13 03:26:55.696031 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 301/628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:26:55 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:26:56.612342 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d7b5346c-2954-4daa-96c6-3f511ae5faa2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:56.613206 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d7b5346c-2954-4daa-96c6-3f511ae5faa2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:56.619688 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d7b5346c-2954-4daa-96c6-3f511ae5faa2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:56.620189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d7b5346c-2954-4daa-96c6-3f511ae5faa2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:56.620642 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d7b5346c-2954-4daa-96c6-3f511ae5faa2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:56.621885 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d7b5346c-2954-4daa-96c6-3f511ae5faa2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:56.622347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d7b5346c-2954-4daa-96c6-3f511ae5faa2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:56.622822 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d7b5346c-2954-4daa-96c6-3f511ae5faa2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:56.753418 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d7b5346c-2954-4daa-96c6-3f511ae5faa2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:56.762597 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d7b5346c-2954-4daa-96c6-3f511ae5faa2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:56.764153 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d7b5346c-2954-4daa-96c6-3f511ae5faa2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:56.765413 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d7b5346c-2954-4daa-96c6-3f511ae5faa2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.156893 Sep 13 03:26:56.766001 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 328/629] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:56 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:57.419748 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-1ad8ba48-24fd-4d7d-8c99-6222ac88d44c req-f6a288f9-62d6-46c5-bd8c-9f5fb4790d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4319ab9-e7a2-45ea-ae43-c9860ed33cef", "tag": "b5169432-a539-41f3-a735-e6f12d3f1fbc"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:26:57.430042 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-1ad8ba48-24fd-4d7d-8c99-6222ac88d44c req-f6a288f9-62d6-46c5-bd8c-9f5fb4790d61 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:57.430690 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-1ad8ba48-24fd-4d7d-8c99-6222ac88d44c req-f6a288f9-62d6-46c5-bd8c-9f5fb4790d61 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:57.431124 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-1ad8ba48-24fd-4d7d-8c99-6222ac88d44c req-f6a288f9-62d6-46c5-bd8c-9f5fb4790d61 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:57.443278 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-1ad8ba48-24fd-4d7d-8c99-6222ac88d44c req-f6a288f9-62d6-46c5-bd8c-9f5fb4790d61 service nova] Creating event network-changed:b5169432-a539-41f3-a735-e6f12d3f1fbc for instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef on hv-cinder-85707 Sep 13 03:26:57.448653 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-1ad8ba48-24fd-4d7d-8c99-6222ac88d44c req-f6a288f9-62d6-46c5-bd8c-9f5fb4790d61 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033141 Sep 13 03:26:57.450157 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 302/630] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:26:57.790033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0801b183-9577-417e-ba60-9db6bd743ab7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:57.790682 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0801b183-9577-417e-ba60-9db6bd743ab7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:57.798693 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0801b183-9577-417e-ba60-9db6bd743ab7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:57.799074 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0801b183-9577-417e-ba60-9db6bd743ab7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:57.799800 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0801b183-9577-417e-ba60-9db6bd743ab7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:57.800172 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0801b183-9577-417e-ba60-9db6bd743ab7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:57.800631 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0801b183-9577-417e-ba60-9db6bd743ab7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:57.801064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0801b183-9577-417e-ba60-9db6bd743ab7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:58.013785 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0801b183-9577-417e-ba60-9db6bd743ab7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:58.022867 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0801b183-9577-417e-ba60-9db6bd743ab7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:58.024296 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0801b183-9577-417e-ba60-9db6bd743ab7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:58.025579 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0801b183-9577-417e-ba60-9db6bd743ab7 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.239482 Sep 13 03:26:58.026254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 329/631] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:57 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:26:59.052477 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d270f8ec-8a53-430d-88a8-3a37a3c8892e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:26:59.053308 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d270f8ec-8a53-430d-88a8-3a37a3c8892e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:26:59.061323 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d270f8ec-8a53-430d-88a8-3a37a3c8892e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:59.062012 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d270f8ec-8a53-430d-88a8-3a37a3c8892e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:59.062549 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d270f8ec-8a53-430d-88a8-3a37a3c8892e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:59.063421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d270f8ec-8a53-430d-88a8-3a37a3c8892e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:26:59.064081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d270f8ec-8a53-430d-88a8-3a37a3c8892e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:26:59.064750 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d270f8ec-8a53-430d-88a8-3a37a3c8892e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:26:59.204671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d270f8ec-8a53-430d-88a8-3a37a3c8892e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:59.213508 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d270f8ec-8a53-430d-88a8-3a37a3c8892e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:59.214971 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d270f8ec-8a53-430d-88a8-3a37a3c8892e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:26:59.216138 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d270f8ec-8a53-430d-88a8-3a37a3c8892e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.168056 Sep 13 03:26:59.216694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 303/632] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:26:59 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:27:00.244857 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b5b4bd89-d9d6-4bd2-89fb-7c3d0804d485 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:00.246134 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b5b4bd89-d9d6-4bd2-89fb-7c3d0804d485 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:00.261339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b5b4bd89-d9d6-4bd2-89fb-7c3d0804d485 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:00.262345 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b5b4bd89-d9d6-4bd2-89fb-7c3d0804d485 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:00.262823 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b5b4bd89-d9d6-4bd2-89fb-7c3d0804d485 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:00.263563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b5b4bd89-d9d6-4bd2-89fb-7c3d0804d485 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:00.264016 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b5b4bd89-d9d6-4bd2-89fb-7c3d0804d485 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:00.264437 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b5b4bd89-d9d6-4bd2-89fb-7c3d0804d485 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:00.408396 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b5b4bd89-d9d6-4bd2-89fb-7c3d0804d485 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:00.417697 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b5b4bd89-d9d6-4bd2-89fb-7c3d0804d485 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:00.419345 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b5b4bd89-d9d6-4bd2-89fb-7c3d0804d485 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:00.420650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b5b4bd89-d9d6-4bd2-89fb-7c3d0804d485 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.179999 Sep 13 03:27:00.421358 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 330/633] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:00 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:01.446136 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d9c4c2e0-cabb-4089-97c7-52e51dcfe0c1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:01.446810 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d9c4c2e0-cabb-4089-97c7-52e51dcfe0c1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:01.454162 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d9c4c2e0-cabb-4089-97c7-52e51dcfe0c1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:01.454744 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d9c4c2e0-cabb-4089-97c7-52e51dcfe0c1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:01.455196 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d9c4c2e0-cabb-4089-97c7-52e51dcfe0c1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:01.455909 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d9c4c2e0-cabb-4089-97c7-52e51dcfe0c1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:01.456397 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d9c4c2e0-cabb-4089-97c7-52e51dcfe0c1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:01.456815 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d9c4c2e0-cabb-4089-97c7-52e51dcfe0c1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:01.594958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d9c4c2e0-cabb-4089-97c7-52e51dcfe0c1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:01.603907 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d9c4c2e0-cabb-4089-97c7-52e51dcfe0c1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:01.605444 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d9c4c2e0-cabb-4089-97c7-52e51dcfe0c1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:01.606712 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d9c4c2e0-cabb-4089-97c7-52e51dcfe0c1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.164429 Sep 13 03:27:01.607281 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 304/634] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:01 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:02.634073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-87795fcd-812a-4183-9406-f8156ff66826 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:02.634994 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-87795fcd-812a-4183-9406-f8156ff66826 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:02.642268 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-87795fcd-812a-4183-9406-f8156ff66826 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:02.642785 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-87795fcd-812a-4183-9406-f8156ff66826 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:02.643216 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-87795fcd-812a-4183-9406-f8156ff66826 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:02.643903 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-87795fcd-812a-4183-9406-f8156ff66826 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:02.644349 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-87795fcd-812a-4183-9406-f8156ff66826 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:02.644793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-87795fcd-812a-4183-9406-f8156ff66826 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:02.781429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-87795fcd-812a-4183-9406-f8156ff66826 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:02.790935 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-87795fcd-812a-4183-9406-f8156ff66826 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:02.792787 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-87795fcd-812a-4183-9406-f8156ff66826 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:02.794453 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-87795fcd-812a-4183-9406-f8156ff66826 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.165467 Sep 13 03:27:02.795237 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 331/635] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:02 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:03.820370 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ba394609-f210-47a7-884e-3140f5ee7a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:03.821071 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ba394609-f210-47a7-884e-3140f5ee7a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:03.828111 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba394609-f210-47a7-884e-3140f5ee7a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:03.828815 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba394609-f210-47a7-884e-3140f5ee7a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:03.829409 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba394609-f210-47a7-884e-3140f5ee7a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:03.830231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba394609-f210-47a7-884e-3140f5ee7a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:03.830790 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba394609-f210-47a7-884e-3140f5ee7a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:03.831278 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ba394609-f210-47a7-884e-3140f5ee7a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:03.968412 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ba394609-f210-47a7-884e-3140f5ee7a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:03.977173 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ba394609-f210-47a7-884e-3140f5ee7a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:03.978657 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ba394609-f210-47a7-884e-3140f5ee7a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:03.979823 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ba394609-f210-47a7-884e-3140f5ee7a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.163683 Sep 13 03:27:03.980901 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 305/636] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:03 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:05.005308 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-fee1f91c-4892-49df-bdc2-3e0cba033e15 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:05.005910 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-fee1f91c-4892-49df-bdc2-3e0cba033e15 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:05.013406 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fee1f91c-4892-49df-bdc2-3e0cba033e15 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:05.013884 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fee1f91c-4892-49df-bdc2-3e0cba033e15 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:05.014316 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fee1f91c-4892-49df-bdc2-3e0cba033e15 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:05.015018 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fee1f91c-4892-49df-bdc2-3e0cba033e15 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:05.015469 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fee1f91c-4892-49df-bdc2-3e0cba033e15 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:05.015886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fee1f91c-4892-49df-bdc2-3e0cba033e15 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:05.033698 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:27:05.158812 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-fee1f91c-4892-49df-bdc2-3e0cba033e15 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:05.167858 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-fee1f91c-4892-49df-bdc2-3e0cba033e15 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:05.169306 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-fee1f91c-4892-49df-bdc2-3e0cba033e15 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:05.170780 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-fee1f91c-4892-49df-bdc2-3e0cba033e15 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.169162 Sep 13 03:27:05.171356 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 332/637] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:05 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:06.196721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-917975fb-67cd-4556-bc85-6470668df89f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:06.197319 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-917975fb-67cd-4556-bc85-6470668df89f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:06.204644 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-917975fb-67cd-4556-bc85-6470668df89f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:06.205157 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-917975fb-67cd-4556-bc85-6470668df89f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:06.205619 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-917975fb-67cd-4556-bc85-6470668df89f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:06.206391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-917975fb-67cd-4556-bc85-6470668df89f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:06.206935 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-917975fb-67cd-4556-bc85-6470668df89f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:06.207386 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-917975fb-67cd-4556-bc85-6470668df89f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:06.341352 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-917975fb-67cd-4556-bc85-6470668df89f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:06.350320 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-917975fb-67cd-4556-bc85-6470668df89f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:06.351800 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-917975fb-67cd-4556-bc85-6470668df89f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:06.352992 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-917975fb-67cd-4556-bc85-6470668df89f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.160211 Sep 13 03:27:06.353601 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 306/638] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:06 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:27:07.378089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-de712b43-84d1-4291-afcc-372113a8184f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:07.378803 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-de712b43-84d1-4291-afcc-372113a8184f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:07.390902 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de712b43-84d1-4291-afcc-372113a8184f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:07.391174 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de712b43-84d1-4291-afcc-372113a8184f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:07.391610 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de712b43-84d1-4291-afcc-372113a8184f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:07.392318 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de712b43-84d1-4291-afcc-372113a8184f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:07.392773 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de712b43-84d1-4291-afcc-372113a8184f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:07.393196 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-de712b43-84d1-4291-afcc-372113a8184f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:07.528532 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-de712b43-84d1-4291-afcc-372113a8184f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:07.538007 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-de712b43-84d1-4291-afcc-372113a8184f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:07.539486 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-de712b43-84d1-4291-afcc-372113a8184f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:07.541424 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-de712b43-84d1-4291-afcc-372113a8184f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.166698 Sep 13 03:27:07.541912 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 333/639] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:07 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:07.621611 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b20775ad-12a5-4ace-aa2a-a0a13e7aec39 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffa8ce3e-d612-48e7-9087-3c413ea0028c"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:27:07.624694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b20775ad-12a5-4ace-aa2a-a0a13e7aec39 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:07.631003 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b20775ad-12a5-4ace-aa2a-a0a13e7aec39 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:07.631736 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b20775ad-12a5-4ace-aa2a-a0a13e7aec39 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:07.632360 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b20775ad-12a5-4ace-aa2a-a0a13e7aec39 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:07.633250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b20775ad-12a5-4ace-aa2a-a0a13e7aec39 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:07.633871 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b20775ad-12a5-4ace-aa2a-a0a13e7aec39 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:07.634463 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b20775ad-12a5-4ace-aa2a-a0a13e7aec39 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:08.566567 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f408b523-3a6c-497c-987a-1d02e1c6edb8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:08.567223 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f408b523-3a6c-497c-987a-1d02e1c6edb8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:08.573846 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f408b523-3a6c-497c-987a-1d02e1c6edb8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:08.574341 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f408b523-3a6c-497c-987a-1d02e1c6edb8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:08.574806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f408b523-3a6c-497c-987a-1d02e1c6edb8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:08.576150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f408b523-3a6c-497c-987a-1d02e1c6edb8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:08.576611 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f408b523-3a6c-497c-987a-1d02e1c6edb8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:08.577044 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f408b523-3a6c-497c-987a-1d02e1c6edb8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:08.714166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f408b523-3a6c-497c-987a-1d02e1c6edb8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:08.723218 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f408b523-3a6c-497c-987a-1d02e1c6edb8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:08.724961 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f408b523-3a6c-497c-987a-1d02e1c6edb8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:08.726119 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f408b523-3a6c-497c-987a-1d02e1c6edb8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.163424 Sep 13 03:27:08.726690 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 334/640] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:08 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:27:09.751500 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-52e84a4f-d241-4fef-9cd8-01308c479cb6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:09.752160 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-52e84a4f-d241-4fef-9cd8-01308c479cb6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:09.758353 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-52e84a4f-d241-4fef-9cd8-01308c479cb6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:09.758868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-52e84a4f-d241-4fef-9cd8-01308c479cb6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:09.759307 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-52e84a4f-d241-4fef-9cd8-01308c479cb6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:09.759986 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-52e84a4f-d241-4fef-9cd8-01308c479cb6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:09.760436 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-52e84a4f-d241-4fef-9cd8-01308c479cb6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:09.760853 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-52e84a4f-d241-4fef-9cd8-01308c479cb6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:09.890885 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-52e84a4f-d241-4fef-9cd8-01308c479cb6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:09.899274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-52e84a4f-d241-4fef-9cd8-01308c479cb6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:09.900694 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-52e84a4f-d241-4fef-9cd8-01308c479cb6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:09.901857 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-52e84a4f-d241-4fef-9cd8-01308c479cb6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.154662 Sep 13 03:27:09.902408 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 335/641] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:09 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:27:10.927872 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-56f3d500-20c8-49a5-b82f-be9723a2d0f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:10.928546 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-56f3d500-20c8-49a5-b82f-be9723a2d0f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:10.934822 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56f3d500-20c8-49a5-b82f-be9723a2d0f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:10.935399 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56f3d500-20c8-49a5-b82f-be9723a2d0f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:10.935902 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56f3d500-20c8-49a5-b82f-be9723a2d0f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:10.936644 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56f3d500-20c8-49a5-b82f-be9723a2d0f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:10.937251 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56f3d500-20c8-49a5-b82f-be9723a2d0f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:10.937712 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-56f3d500-20c8-49a5-b82f-be9723a2d0f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:11.067938 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-56f3d500-20c8-49a5-b82f-be9723a2d0f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:11.076884 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-56f3d500-20c8-49a5-b82f-be9723a2d0f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:11.078299 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-56f3d500-20c8-49a5-b82f-be9723a2d0f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:11.079472 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-56f3d500-20c8-49a5-b82f-be9723a2d0f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.155571 Sep 13 03:27:11.080027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 336/642] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:10 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:27:12.106968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3ab4a526-ddb8-4e29-9276-22525a329750 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:12.107579 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3ab4a526-ddb8-4e29-9276-22525a329750 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:12.113874 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ab4a526-ddb8-4e29-9276-22525a329750 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:12.114357 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ab4a526-ddb8-4e29-9276-22525a329750 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:12.114841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ab4a526-ddb8-4e29-9276-22525a329750 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:12.115526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ab4a526-ddb8-4e29-9276-22525a329750 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:12.115981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ab4a526-ddb8-4e29-9276-22525a329750 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:12.116404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ab4a526-ddb8-4e29-9276-22525a329750 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:12.245499 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3ab4a526-ddb8-4e29-9276-22525a329750 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:12.253927 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3ab4a526-ddb8-4e29-9276-22525a329750 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:12.255392 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3ab4a526-ddb8-4e29-9276-22525a329750 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:12.256549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3ab4a526-ddb8-4e29-9276-22525a329750 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.153995 Sep 13 03:27:12.257102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 337/643] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:12 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:27:13.083041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b20775ad-12a5-4ace-aa2a-a0a13e7aec39 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "POST /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.594579 Sep 13 03:27:13.083647 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 307/644] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:27:07 2022] POST /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments => generated 194 bytes in 5596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:27:13.281543 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-339b19ab-5c3d-4888-9457-f93668bf21d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:13.282074 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-339b19ab-5c3d-4888-9457-f93668bf21d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:13.284390 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=48 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:27:13.289419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-339b19ab-5c3d-4888-9457-f93668bf21d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:13.289923 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-339b19ab-5c3d-4888-9457-f93668bf21d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:13.290360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-339b19ab-5c3d-4888-9457-f93668bf21d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:13.291349 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-339b19ab-5c3d-4888-9457-f93668bf21d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:13.291796 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-339b19ab-5c3d-4888-9457-f93668bf21d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:13.292212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-339b19ab-5c3d-4888-9457-f93668bf21d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:13.417536 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-339b19ab-5c3d-4888-9457-f93668bf21d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:13.426553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-339b19ab-5c3d-4888-9457-f93668bf21d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:13.428068 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-339b19ab-5c3d-4888-9457-f93668bf21d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:13.429198 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-339b19ab-5c3d-4888-9457-f93668bf21d5 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.151592 Sep 13 03:27:13.429756 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 338/645] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:13 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:14.456076 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5a421c24-ba65-41da-aad3-e91e56d73fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:14.456762 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5a421c24-ba65-41da-aad3-e91e56d73fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:14.458738 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:27:14.464782 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a421c24-ba65-41da-aad3-e91e56d73fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:14.465286 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a421c24-ba65-41da-aad3-e91e56d73fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:14.465760 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a421c24-ba65-41da-aad3-e91e56d73fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:14.466442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a421c24-ba65-41da-aad3-e91e56d73fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:14.466926 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a421c24-ba65-41da-aad3-e91e56d73fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:14.467345 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a421c24-ba65-41da-aad3-e91e56d73fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:14.797790 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5a421c24-ba65-41da-aad3-e91e56d73fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:14.806160 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5a421c24-ba65-41da-aad3-e91e56d73fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:14.807616 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5a421c24-ba65-41da-aad3-e91e56d73fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:14.808758 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5a421c24-ba65-41da-aad3-e91e56d73fe1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.358081 Sep 13 03:27:14.809795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 308/646] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:14 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:15.834668 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4b86beca-cdb5-4c49-9983-851bee1cd215 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:15.835282 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4b86beca-cdb5-4c49-9983-851bee1cd215 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:15.842119 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b86beca-cdb5-4c49-9983-851bee1cd215 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:15.842592 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b86beca-cdb5-4c49-9983-851bee1cd215 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:15.843045 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b86beca-cdb5-4c49-9983-851bee1cd215 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:15.843717 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b86beca-cdb5-4c49-9983-851bee1cd215 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:15.844168 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b86beca-cdb5-4c49-9983-851bee1cd215 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:15.844586 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b86beca-cdb5-4c49-9983-851bee1cd215 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:15.973225 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4b86beca-cdb5-4c49-9983-851bee1cd215 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:15.981813 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4b86beca-cdb5-4c49-9983-851bee1cd215 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:15.983270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4b86beca-cdb5-4c49-9983-851bee1cd215 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:15.984418 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4b86beca-cdb5-4c49-9983-851bee1cd215 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.153711 Sep 13 03:27:15.984969 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 339/647] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:15 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:17.010798 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5f3ef062-a86e-4215-9bb8-c81b648ad8ca tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:17.011411 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5f3ef062-a86e-4215-9bb8-c81b648ad8ca tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:17.017890 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f3ef062-a86e-4215-9bb8-c81b648ad8ca tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:17.018377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f3ef062-a86e-4215-9bb8-c81b648ad8ca tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:17.018846 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f3ef062-a86e-4215-9bb8-c81b648ad8ca tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:17.019532 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f3ef062-a86e-4215-9bb8-c81b648ad8ca tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:17.019982 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f3ef062-a86e-4215-9bb8-c81b648ad8ca tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:17.020403 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f3ef062-a86e-4215-9bb8-c81b648ad8ca tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:17.038302 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:27:17.150734 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5f3ef062-a86e-4215-9bb8-c81b648ad8ca tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:17.159688 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5f3ef062-a86e-4215-9bb8-c81b648ad8ca tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:17.161114 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5f3ef062-a86e-4215-9bb8-c81b648ad8ca tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:17.162264 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5f3ef062-a86e-4215-9bb8-c81b648ad8ca tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.155487 Sep 13 03:27:17.162880 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 309/648] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:17 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:18.187821 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-76a6e086-44f3-430c-8cc0-30104a2aaa22 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:18.188435 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-76a6e086-44f3-430c-8cc0-30104a2aaa22 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:18.194891 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76a6e086-44f3-430c-8cc0-30104a2aaa22 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:18.195379 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76a6e086-44f3-430c-8cc0-30104a2aaa22 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:18.195818 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76a6e086-44f3-430c-8cc0-30104a2aaa22 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:18.196500 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76a6e086-44f3-430c-8cc0-30104a2aaa22 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:18.196955 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76a6e086-44f3-430c-8cc0-30104a2aaa22 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:18.197378 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-76a6e086-44f3-430c-8cc0-30104a2aaa22 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:18.321460 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-76a6e086-44f3-430c-8cc0-30104a2aaa22 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:18.329947 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-76a6e086-44f3-430c-8cc0-30104a2aaa22 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:18.331445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-76a6e086-44f3-430c-8cc0-30104a2aaa22 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:18.332595 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-76a6e086-44f3-430c-8cc0-30104a2aaa22 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.149197 Sep 13 03:27:18.333156 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 340/649] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:18 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:19.358291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4e2d7766-5f78-4492-97d7-1d012e81b7b9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:19.358834 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-4e2d7766-5f78-4492-97d7-1d012e81b7b9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:19.365164 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4e2d7766-5f78-4492-97d7-1d012e81b7b9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:19.365639 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4e2d7766-5f78-4492-97d7-1d012e81b7b9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:19.366068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4e2d7766-5f78-4492-97d7-1d012e81b7b9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:19.366771 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4e2d7766-5f78-4492-97d7-1d012e81b7b9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:19.367220 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4e2d7766-5f78-4492-97d7-1d012e81b7b9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:19.367635 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4e2d7766-5f78-4492-97d7-1d012e81b7b9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:19.497432 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4e2d7766-5f78-4492-97d7-1d012e81b7b9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:19.506127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4e2d7766-5f78-4492-97d7-1d012e81b7b9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:19.507586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4e2d7766-5f78-4492-97d7-1d012e81b7b9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:19.508795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4e2d7766-5f78-4492-97d7-1d012e81b7b9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.154926 Sep 13 03:27:19.509344 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 310/650] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:19 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:20.533466 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-071a1332-1d8b-4230-9a24-ddc13f7f7e8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:20.534195 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-071a1332-1d8b-4230-9a24-ddc13f7f7e8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:20.540714 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-071a1332-1d8b-4230-9a24-ddc13f7f7e8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:20.541498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-071a1332-1d8b-4230-9a24-ddc13f7f7e8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:20.541938 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-071a1332-1d8b-4230-9a24-ddc13f7f7e8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:20.542646 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-071a1332-1d8b-4230-9a24-ddc13f7f7e8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:20.543107 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-071a1332-1d8b-4230-9a24-ddc13f7f7e8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:20.543537 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-071a1332-1d8b-4230-9a24-ddc13f7f7e8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:20.671160 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-071a1332-1d8b-4230-9a24-ddc13f7f7e8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:20.679549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-071a1332-1d8b-4230-9a24-ddc13f7f7e8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:20.680985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-071a1332-1d8b-4230-9a24-ddc13f7f7e8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:20.682146 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-071a1332-1d8b-4230-9a24-ddc13f7f7e8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.152515 Sep 13 03:27:20.682732 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 341/651] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:20 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:21.707768 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-541f9a00-4de4-4ba8-a4b9-fb9608386b3b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:21.708501 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-541f9a00-4de4-4ba8-a4b9-fb9608386b3b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:21.715092 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-541f9a00-4de4-4ba8-a4b9-fb9608386b3b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:21.715608 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-541f9a00-4de4-4ba8-a4b9-fb9608386b3b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:21.716083 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-541f9a00-4de4-4ba8-a4b9-fb9608386b3b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:21.716780 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-541f9a00-4de4-4ba8-a4b9-fb9608386b3b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:21.717263 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-541f9a00-4de4-4ba8-a4b9-fb9608386b3b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:21.717662 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-541f9a00-4de4-4ba8-a4b9-fb9608386b3b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:21.843312 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-541f9a00-4de4-4ba8-a4b9-fb9608386b3b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:21.851835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-541f9a00-4de4-4ba8-a4b9-fb9608386b3b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:21.853286 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-541f9a00-4de4-4ba8-a4b9-fb9608386b3b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:21.854440 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-541f9a00-4de4-4ba8-a4b9-fb9608386b3b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.150632 Sep 13 03:27:21.855036 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 311/652] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:21 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:27:22.881000 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3ec70cec-8cd3-48dc-af67-9dd51e238630 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:22.881513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3ec70cec-8cd3-48dc-af67-9dd51e238630 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:22.888711 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ec70cec-8cd3-48dc-af67-9dd51e238630 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:22.889195 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ec70cec-8cd3-48dc-af67-9dd51e238630 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:22.889627 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ec70cec-8cd3-48dc-af67-9dd51e238630 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:22.890315 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ec70cec-8cd3-48dc-af67-9dd51e238630 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:22.890806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ec70cec-8cd3-48dc-af67-9dd51e238630 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:22.891231 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3ec70cec-8cd3-48dc-af67-9dd51e238630 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:23.018968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3ec70cec-8cd3-48dc-af67-9dd51e238630 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:23.027321 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3ec70cec-8cd3-48dc-af67-9dd51e238630 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:23.028743 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3ec70cec-8cd3-48dc-af67-9dd51e238630 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:23.029972 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3ec70cec-8cd3-48dc-af67-9dd51e238630 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.152954 Sep 13 03:27:23.030534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 342/653] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:22 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:23.784404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-13232df1-8d05-43bf-b6a8-a1f3d49f1476 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:27:23.786787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-13232df1-8d05-43bf-b6a8-a1f3d49f1476 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:23.794013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-13232df1-8d05-43bf-b6a8-a1f3d49f1476 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:23.794502 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-13232df1-8d05-43bf-b6a8-a1f3d49f1476 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:23.794989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-13232df1-8d05-43bf-b6a8-a1f3d49f1476 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:23.795679 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-13232df1-8d05-43bf-b6a8-a1f3d49f1476 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:23.796160 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-13232df1-8d05-43bf-b6a8-a1f3d49f1476 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:23.796583 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-13232df1-8d05-43bf-b6a8-a1f3d49f1476 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:23.820247 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-13232df1-8d05-43bf-b6a8-a1f3d49f1476 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lazy-loading 'flavor' on Instance uuid 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:27:23.944469 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-13232df1-8d05-43bf-b6a8-a1f3d49f1476 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "POST /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/action" status: 200 len: 32 microversion: 2.1 time: 0.164020 Sep 13 03:27:23.945255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 312/654] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:27:23 2022] POST /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 03:27:23.954939 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c9f2d9f8-d090-43cb-8183-ec4a2984d89a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:23.955558 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c9f2d9f8-d090-43cb-8183-ec4a2984d89a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:23.963405 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c9f2d9f8-d090-43cb-8183-ec4a2984d89a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:23.963894 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c9f2d9f8-d090-43cb-8183-ec4a2984d89a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:23.964341 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c9f2d9f8-d090-43cb-8183-ec4a2984d89a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:23.965052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c9f2d9f8-d090-43cb-8183-ec4a2984d89a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:23.966102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c9f2d9f8-d090-43cb-8183-ec4a2984d89a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:23.967030 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c9f2d9f8-d090-43cb-8183-ec4a2984d89a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:24.055926 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-dd82af71-f049-4e1a-a8cf-8e7145bbadc1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:24.056653 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-dd82af71-f049-4e1a-a8cf-8e7145bbadc1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:24.063178 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dd82af71-f049-4e1a-a8cf-8e7145bbadc1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:24.063680 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dd82af71-f049-4e1a-a8cf-8e7145bbadc1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:24.064117 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dd82af71-f049-4e1a-a8cf-8e7145bbadc1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:24.064833 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dd82af71-f049-4e1a-a8cf-8e7145bbadc1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:24.065296 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dd82af71-f049-4e1a-a8cf-8e7145bbadc1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:24.065891 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dd82af71-f049-4e1a-a8cf-8e7145bbadc1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:24.207447 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-dd82af71-f049-4e1a-a8cf-8e7145bbadc1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:24.216524 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-dd82af71-f049-4e1a-a8cf-8e7145bbadc1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:24.217964 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-dd82af71-f049-4e1a-a8cf-8e7145bbadc1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:24.219261 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-dd82af71-f049-4e1a-a8cf-8e7145bbadc1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.167845 Sep 13 03:27:24.219831 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 313/655] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:24 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:27:24.435024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c9f2d9f8-d090-43cb-8183-ec4a2984d89a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:24.443197 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c9f2d9f8-d090-43cb-8183-ec4a2984d89a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.492133 Sep 13 03:27:24.443770 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 343/656] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:23 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:25.244747 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c272a77a-5ea6-44d4-a032-3dc2f907bbfb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:25.245466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c272a77a-5ea6-44d4-a032-3dc2f907bbfb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:25.252687 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c272a77a-5ea6-44d4-a032-3dc2f907bbfb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:25.253175 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c272a77a-5ea6-44d4-a032-3dc2f907bbfb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:25.253730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c272a77a-5ea6-44d4-a032-3dc2f907bbfb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:25.254428 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c272a77a-5ea6-44d4-a032-3dc2f907bbfb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:25.254903 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c272a77a-5ea6-44d4-a032-3dc2f907bbfb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:25.255324 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c272a77a-5ea6-44d4-a032-3dc2f907bbfb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:25.383513 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c272a77a-5ea6-44d4-a032-3dc2f907bbfb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:25.392140 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c272a77a-5ea6-44d4-a032-3dc2f907bbfb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:25.393842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c272a77a-5ea6-44d4-a032-3dc2f907bbfb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:25.395134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c272a77a-5ea6-44d4-a032-3dc2f907bbfb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.154355 Sep 13 03:27:25.395845 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 314/657] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:25 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:25.399932 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-403defae-93f7-4f52-9e7b-2e38e21dd56e req-88c2207b-794e-42e0-bf0a-bad9e8f42a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97f011a-6370-474e-9a62-e9229eb7d7ee", "name": "network-vif-plugged", "status": "completed", "tag": "1c922edb-7dd6-4a91-ba67-004272056f1c"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:27:25.410085 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-403defae-93f7-4f52-9e7b-2e38e21dd56e req-88c2207b-794e-42e0-bf0a-bad9e8f42a51 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:25.410567 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-403defae-93f7-4f52-9e7b-2e38e21dd56e req-88c2207b-794e-42e0-bf0a-bad9e8f42a51 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:25.411128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-403defae-93f7-4f52-9e7b-2e38e21dd56e req-88c2207b-794e-42e0-bf0a-bad9e8f42a51 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:25.423494 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-403defae-93f7-4f52-9e7b-2e38e21dd56e req-88c2207b-794e-42e0-bf0a-bad9e8f42a51 service nova] Creating event network-vif-plugged:1c922edb-7dd6-4a91-ba67-004272056f1c for instance a97f011a-6370-474e-9a62-e9229eb7d7ee on hv-cinder-85707 Sep 13 03:27:25.428584 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-403defae-93f7-4f52-9e7b-2e38e21dd56e req-88c2207b-794e-42e0-bf0a-bad9e8f42a51 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032361 Sep 13 03:27:25.429384 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 344/658] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:27:25.465900 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-bf2fc83e-7dd5-4570-8a33-dc7dc5e735ae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:25.466596 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-bf2fc83e-7dd5-4570-8a33-dc7dc5e735ae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:25.472642 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bf2fc83e-7dd5-4570-8a33-dc7dc5e735ae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:25.473125 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bf2fc83e-7dd5-4570-8a33-dc7dc5e735ae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:25.473559 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bf2fc83e-7dd5-4570-8a33-dc7dc5e735ae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:25.474248 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bf2fc83e-7dd5-4570-8a33-dc7dc5e735ae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:25.474727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bf2fc83e-7dd5-4570-8a33-dc7dc5e735ae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:25.475168 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bf2fc83e-7dd5-4570-8a33-dc7dc5e735ae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:25.603373 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-bf2fc83e-7dd5-4570-8a33-dc7dc5e735ae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:25.611989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-bf2fc83e-7dd5-4570-8a33-dc7dc5e735ae tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.149997 Sep 13 03:27:25.612555 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 315/659] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:25 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:26.423490 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a7454c75-f9df-4162-b964-2af585af3734 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:26.424194 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a7454c75-f9df-4162-b964-2af585af3734 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:26.430658 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a7454c75-f9df-4162-b964-2af585af3734 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:26.431144 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a7454c75-f9df-4162-b964-2af585af3734 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:26.431593 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a7454c75-f9df-4162-b964-2af585af3734 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:26.432262 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a7454c75-f9df-4162-b964-2af585af3734 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:26.432717 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a7454c75-f9df-4162-b964-2af585af3734 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:26.433137 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a7454c75-f9df-4162-b964-2af585af3734 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:26.558558 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a7454c75-f9df-4162-b964-2af585af3734 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:26.567513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a7454c75-f9df-4162-b964-2af585af3734 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:26.568945 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a7454c75-f9df-4162-b964-2af585af3734 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:26.570120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a7454c75-f9df-4162-b964-2af585af3734 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.150857 Sep 13 03:27:26.570677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 345/660] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:26 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:26.635401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-dff5040b-9aac-4933-a3a6-f1d364b02535 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:26.636014 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-dff5040b-9aac-4933-a3a6-f1d364b02535 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:26.643003 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dff5040b-9aac-4933-a3a6-f1d364b02535 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:26.643482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dff5040b-9aac-4933-a3a6-f1d364b02535 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:26.643913 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dff5040b-9aac-4933-a3a6-f1d364b02535 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:26.644593 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dff5040b-9aac-4933-a3a6-f1d364b02535 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:26.645044 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dff5040b-9aac-4933-a3a6-f1d364b02535 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:26.645462 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dff5040b-9aac-4933-a3a6-f1d364b02535 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:26.773401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-dff5040b-9aac-4933-a3a6-f1d364b02535 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:26.781455 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-dff5040b-9aac-4933-a3a6-f1d364b02535 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.149880 Sep 13 03:27:26.782017 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 316/661] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:26 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:27.596070 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4de00f26-76aa-4024-abff-291f8c9d7127 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:27.596701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4de00f26-76aa-4024-abff-291f8c9d7127 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:27.603072 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4de00f26-76aa-4024-abff-291f8c9d7127 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:27.603555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4de00f26-76aa-4024-abff-291f8c9d7127 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:27.603990 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4de00f26-76aa-4024-abff-291f8c9d7127 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:27.604691 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4de00f26-76aa-4024-abff-291f8c9d7127 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:27.605129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4de00f26-76aa-4024-abff-291f8c9d7127 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:27.605549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4de00f26-76aa-4024-abff-291f8c9d7127 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:27.733769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4de00f26-76aa-4024-abff-291f8c9d7127 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:27.742182 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4de00f26-76aa-4024-abff-291f8c9d7127 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:27.743645 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4de00f26-76aa-4024-abff-291f8c9d7127 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:27.744801 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4de00f26-76aa-4024-abff-291f8c9d7127 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.153196 Sep 13 03:27:27.745365 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 346/662] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:27 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:27.805069 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6d0a3a51-fbf3-4d42-9fb3-54d119fa6b79 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:27.805676 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6d0a3a51-fbf3-4d42-9fb3-54d119fa6b79 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:27.812134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6d0a3a51-fbf3-4d42-9fb3-54d119fa6b79 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:27.812621 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6d0a3a51-fbf3-4d42-9fb3-54d119fa6b79 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:27.813082 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6d0a3a51-fbf3-4d42-9fb3-54d119fa6b79 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:27.813768 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6d0a3a51-fbf3-4d42-9fb3-54d119fa6b79 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:27.814225 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6d0a3a51-fbf3-4d42-9fb3-54d119fa6b79 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:27.814665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6d0a3a51-fbf3-4d42-9fb3-54d119fa6b79 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:27.941361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-6d0a3a51-fbf3-4d42-9fb3-54d119fa6b79 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:27.949372 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6d0a3a51-fbf3-4d42-9fb3-54d119fa6b79 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.148093 Sep 13 03:27:27.949937 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 317/663] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:27 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:28.770209 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-503d61cc-24fe-424a-9fec-4a2f51bec9a0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:28.770867 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-503d61cc-24fe-424a-9fec-4a2f51bec9a0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:28.777268 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-503d61cc-24fe-424a-9fec-4a2f51bec9a0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:28.777744 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-503d61cc-24fe-424a-9fec-4a2f51bec9a0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:28.778173 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-503d61cc-24fe-424a-9fec-4a2f51bec9a0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:28.778880 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-503d61cc-24fe-424a-9fec-4a2f51bec9a0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:28.779330 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-503d61cc-24fe-424a-9fec-4a2f51bec9a0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:28.779744 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-503d61cc-24fe-424a-9fec-4a2f51bec9a0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:28.907011 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-503d61cc-24fe-424a-9fec-4a2f51bec9a0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:28.915487 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-503d61cc-24fe-424a-9fec-4a2f51bec9a0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:28.917176 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-503d61cc-24fe-424a-9fec-4a2f51bec9a0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:28.918333 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-503d61cc-24fe-424a-9fec-4a2f51bec9a0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1808 microversion: 2.20 time: 0.152001 Sep 13 03:27:28.918929 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 347/664] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:28 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:28.972985 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0ca72412-4749-4099-974b-8e28ffb55520 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:28.973587 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0ca72412-4749-4099-974b-8e28ffb55520 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:28.979857 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0ca72412-4749-4099-974b-8e28ffb55520 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:28.980336 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0ca72412-4749-4099-974b-8e28ffb55520 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:28.980765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0ca72412-4749-4099-974b-8e28ffb55520 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:28.981445 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0ca72412-4749-4099-974b-8e28ffb55520 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:28.981890 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0ca72412-4749-4099-974b-8e28ffb55520 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:28.982306 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0ca72412-4749-4099-974b-8e28ffb55520 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:29.114792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0ca72412-4749-4099-974b-8e28ffb55520 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:29.128280 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0ca72412-4749-4099-974b-8e28ffb55520 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.159267 Sep 13 03:27:29.128855 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 318/665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:28 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:29.942844 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d0410d99-981d-48ae-b8a1-543133029a8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:29.943457 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d0410d99-981d-48ae-b8a1-543133029a8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:29.949759 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d0410d99-981d-48ae-b8a1-543133029a8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:29.950242 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d0410d99-981d-48ae-b8a1-543133029a8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:29.950701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d0410d99-981d-48ae-b8a1-543133029a8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:29.951959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d0410d99-981d-48ae-b8a1-543133029a8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:29.952414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d0410d99-981d-48ae-b8a1-543133029a8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:29.952839 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d0410d99-981d-48ae-b8a1-543133029a8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:30.082096 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d0410d99-981d-48ae-b8a1-543133029a8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:30.090575 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d0410d99-981d-48ae-b8a1-543133029a8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:30.092033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d0410d99-981d-48ae-b8a1-543133029a8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:30.093185 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d0410d99-981d-48ae-b8a1-543133029a8d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1795 microversion: 2.20 time: 0.154287 Sep 13 03:27:30.093737 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 348/666] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:27:29 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1795 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:27:30.152183 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a23d9180-806b-4977-a3c6-8dc820ff627d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:30.152786 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a23d9180-806b-4977-a3c6-8dc820ff627d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:30.159591 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a23d9180-806b-4977-a3c6-8dc820ff627d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:30.160075 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a23d9180-806b-4977-a3c6-8dc820ff627d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:30.160508 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a23d9180-806b-4977-a3c6-8dc820ff627d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:30.161188 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a23d9180-806b-4977-a3c6-8dc820ff627d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:30.161640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a23d9180-806b-4977-a3c6-8dc820ff627d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:30.162056 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a23d9180-806b-4977-a3c6-8dc820ff627d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:30.297623 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a23d9180-806b-4977-a3c6-8dc820ff627d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:30.305717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a23d9180-806b-4977-a3c6-8dc820ff627d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.157350 Sep 13 03:27:30.306278 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 319/667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:30 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:31.329276 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b0a0ad9a-7e34-4b3b-9e66-15b88c576338 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:31.329821 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b0a0ad9a-7e34-4b3b-9e66-15b88c576338 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:31.336231 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0a0ad9a-7e34-4b3b-9e66-15b88c576338 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:31.336722 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0a0ad9a-7e34-4b3b-9e66-15b88c576338 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:31.337163 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0a0ad9a-7e34-4b3b-9e66-15b88c576338 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:31.337849 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0a0ad9a-7e34-4b3b-9e66-15b88c576338 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:31.338306 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0a0ad9a-7e34-4b3b-9e66-15b88c576338 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:31.338763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b0a0ad9a-7e34-4b3b-9e66-15b88c576338 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:31.465201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b0a0ad9a-7e34-4b3b-9e66-15b88c576338 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:31.469202 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:27:31.475118 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b0a0ad9a-7e34-4b3b-9e66-15b88c576338 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.150260 Sep 13 03:27:31.475691 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 349/668] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:31 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:32.498063 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3f05b94a-d57e-414e-873a-bae79b3882b7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:32.498699 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3f05b94a-d57e-414e-873a-bae79b3882b7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:32.505103 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f05b94a-d57e-414e-873a-bae79b3882b7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:32.505590 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f05b94a-d57e-414e-873a-bae79b3882b7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:32.506055 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f05b94a-d57e-414e-873a-bae79b3882b7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:32.506769 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f05b94a-d57e-414e-873a-bae79b3882b7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:32.507223 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f05b94a-d57e-414e-873a-bae79b3882b7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:32.507649 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f05b94a-d57e-414e-873a-bae79b3882b7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:32.631991 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3f05b94a-d57e-414e-873a-bae79b3882b7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:32.640852 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3f05b94a-d57e-414e-873a-bae79b3882b7 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.146671 Sep 13 03:27:32.641420 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 320/669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:32 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:33.663753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ccd6cc23-711b-43ce-bcec-229b9490d55d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:33.664370 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ccd6cc23-711b-43ce-bcec-229b9490d55d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:33.670997 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ccd6cc23-711b-43ce-bcec-229b9490d55d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:33.671480 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ccd6cc23-711b-43ce-bcec-229b9490d55d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:33.671912 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ccd6cc23-711b-43ce-bcec-229b9490d55d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:33.672591 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ccd6cc23-711b-43ce-bcec-229b9490d55d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:33.673044 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ccd6cc23-711b-43ce-bcec-229b9490d55d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:33.673460 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ccd6cc23-711b-43ce-bcec-229b9490d55d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:33.800299 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ccd6cc23-711b-43ce-bcec-229b9490d55d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:33.808302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ccd6cc23-711b-43ce-bcec-229b9490d55d tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.148401 Sep 13 03:27:33.808855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 350/670] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:33 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:34.005571 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9ee9e808-cd27-4379-b980-7dc8c0cb5d59 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:34.006136 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9ee9e808-cd27-4379-b980-7dc8c0cb5d59 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:34.012467 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9ee9e808-cd27-4379-b980-7dc8c0cb5d59 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:34.012950 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9ee9e808-cd27-4379-b980-7dc8c0cb5d59 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:34.013389 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9ee9e808-cd27-4379-b980-7dc8c0cb5d59 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:34.014762 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9ee9e808-cd27-4379-b980-7dc8c0cb5d59 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:34.015219 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9ee9e808-cd27-4379-b980-7dc8c0cb5d59 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:34.015643 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9ee9e808-cd27-4379-b980-7dc8c0cb5d59 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:34.093970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-9ee9e808-cd27-4379-b980-7dc8c0cb5d59 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lazy-loading 'services' on Instance uuid c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:27:34.164202 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9ee9e808-cd27-4379-b980-7dc8c0cb5d59 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/os-volume_attachments/10a991dc-6fc1-4cde-926b-db43ec74f3d7" status: 202 len: 0 microversion: 2.1 time: 0.162509 Sep 13 03:27:34.164819 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 321/671] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 03:27:34 2022] DELETE /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/os-volume_attachments/10a991dc-6fc1-4cde-926b-db43ec74f3d7 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:27:34.832319 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0f9f002c-27a3-4b86-b963-9ad26a87491c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:34.833052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0f9f002c-27a3-4b86-b963-9ad26a87491c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:34.839497 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f9f002c-27a3-4b86-b963-9ad26a87491c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:34.839981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f9f002c-27a3-4b86-b963-9ad26a87491c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:34.840410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f9f002c-27a3-4b86-b963-9ad26a87491c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:34.841090 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f9f002c-27a3-4b86-b963-9ad26a87491c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:34.841537 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f9f002c-27a3-4b86-b963-9ad26a87491c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:34.842462 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f9f002c-27a3-4b86-b963-9ad26a87491c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:34.976534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0f9f002c-27a3-4b86-b963-9ad26a87491c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:34.985338 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0f9f002c-27a3-4b86-b963-9ad26a87491c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.158130 Sep 13 03:27:34.985882 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 351/672] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:34 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:35.297304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f1faecc1-4eb8-48b7-903b-f9deb2d87512 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:27:35.304107 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1faecc1-4eb8-48b7-903b-f9deb2d87512 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:35.304600 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1faecc1-4eb8-48b7-903b-f9deb2d87512 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:35.305060 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1faecc1-4eb8-48b7-903b-f9deb2d87512 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:35.327944 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f1faecc1-4eb8-48b7-903b-f9deb2d87512 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Going to try to stop instance {{(pid=120384) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 03:27:35.353335 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:27:35.372823 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f1faecc1-4eb8-48b7-903b-f9deb2d87512 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "POST /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/action" status: 202 len: 0 microversion: 2.1 time: 0.080693 Sep 13 03:27:35.373364 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 322/673] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:27:35 2022] POST /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:27:35.381511 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-744808b2-df96-4619-9f8e-13d26a3ab572 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:35.382160 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-744808b2-df96-4619-9f8e-13d26a3ab572 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:35.388409 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-744808b2-df96-4619-9f8e-13d26a3ab572 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:35.389232 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-744808b2-df96-4619-9f8e-13d26a3ab572 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:35.389789 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-744808b2-df96-4619-9f8e-13d26a3ab572 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:35.390553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-744808b2-df96-4619-9f8e-13d26a3ab572 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:35.391029 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-744808b2-df96-4619-9f8e-13d26a3ab572 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:35.391452 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-744808b2-df96-4619-9f8e-13d26a3ab572 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:35.521020 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-744808b2-df96-4619-9f8e-13d26a3ab572 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:35.528906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-744808b2-df96-4619-9f8e-13d26a3ab572 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.151248 Sep 13 03:27:35.530138 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 352/674] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:35 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:27:36.008790 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6f8408a7-7471-47ab-9bf1-03afa8cdefc3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:36.009489 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6f8408a7-7471-47ab-9bf1-03afa8cdefc3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:36.016231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6f8408a7-7471-47ab-9bf1-03afa8cdefc3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:36.016723 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6f8408a7-7471-47ab-9bf1-03afa8cdefc3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:36.017164 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6f8408a7-7471-47ab-9bf1-03afa8cdefc3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:36.017854 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6f8408a7-7471-47ab-9bf1-03afa8cdefc3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:36.018313 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6f8408a7-7471-47ab-9bf1-03afa8cdefc3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:36.018771 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6f8408a7-7471-47ab-9bf1-03afa8cdefc3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:36.149882 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-6f8408a7-7471-47ab-9bf1-03afa8cdefc3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:36.158050 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6f8408a7-7471-47ab-9bf1-03afa8cdefc3 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.153536 Sep 13 03:27:36.158634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 323/675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:36 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:36.552766 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ac74a817-e677-4654-b8ed-04b8ba7aeb6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:36.553374 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ac74a817-e677-4654-b8ed-04b8ba7aeb6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:36.559843 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ac74a817-e677-4654-b8ed-04b8ba7aeb6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:36.560329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ac74a817-e677-4654-b8ed-04b8ba7aeb6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:36.560761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ac74a817-e677-4654-b8ed-04b8ba7aeb6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:36.561444 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ac74a817-e677-4654-b8ed-04b8ba7aeb6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:36.561893 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ac74a817-e677-4654-b8ed-04b8ba7aeb6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:36.562314 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ac74a817-e677-4654-b8ed-04b8ba7aeb6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:36.690902 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ac74a817-e677-4654-b8ed-04b8ba7aeb6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:36.698439 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ac74a817-e677-4654-b8ed-04b8ba7aeb6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.149557 Sep 13 03:27:36.699041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 353/676] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:36 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:37.181220 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-26d6d6b7-3561-4a4b-8978-ee679a3146a9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:37.181829 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-26d6d6b7-3561-4a4b-8978-ee679a3146a9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:37.188239 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26d6d6b7-3561-4a4b-8978-ee679a3146a9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:37.188724 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26d6d6b7-3561-4a4b-8978-ee679a3146a9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:37.189156 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26d6d6b7-3561-4a4b-8978-ee679a3146a9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:37.189843 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26d6d6b7-3561-4a4b-8978-ee679a3146a9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:37.190296 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26d6d6b7-3561-4a4b-8978-ee679a3146a9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:37.190738 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26d6d6b7-3561-4a4b-8978-ee679a3146a9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:37.316090 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-26d6d6b7-3561-4a4b-8978-ee679a3146a9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:37.324228 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-26d6d6b7-3561-4a4b-8978-ee679a3146a9 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.146805 Sep 13 03:27:37.324721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 324/677] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:37 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:37.720804 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4a4db706-5330-483b-82a9-41432490d462 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:37.721418 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4a4db706-5330-483b-82a9-41432490d462 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:37.727762 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4a4db706-5330-483b-82a9-41432490d462 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:37.728251 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4a4db706-5330-483b-82a9-41432490d462 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:37.728687 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4a4db706-5330-483b-82a9-41432490d462 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:37.729370 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4a4db706-5330-483b-82a9-41432490d462 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:37.729827 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4a4db706-5330-483b-82a9-41432490d462 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:37.730254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4a4db706-5330-483b-82a9-41432490d462 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:37.864460 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4a4db706-5330-483b-82a9-41432490d462 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:37.872127 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4a4db706-5330-483b-82a9-41432490d462 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.155727 Sep 13 03:27:37.872697 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 354/678] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:37 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:38.348518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-151cd35b-13bf-44fa-848f-6fd0c974fd32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:38.349128 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-151cd35b-13bf-44fa-848f-6fd0c974fd32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:38.356145 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-151cd35b-13bf-44fa-848f-6fd0c974fd32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:38.356631 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-151cd35b-13bf-44fa-848f-6fd0c974fd32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:38.357061 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-151cd35b-13bf-44fa-848f-6fd0c974fd32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:38.357752 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-151cd35b-13bf-44fa-848f-6fd0c974fd32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:38.358201 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-151cd35b-13bf-44fa-848f-6fd0c974fd32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:38.359288 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-151cd35b-13bf-44fa-848f-6fd0c974fd32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:38.489203 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-151cd35b-13bf-44fa-848f-6fd0c974fd32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:38.497167 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-151cd35b-13bf-44fa-848f-6fd0c974fd32 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.152516 Sep 13 03:27:38.497720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 325/679] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:38 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:38.895946 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-37b1b61c-628e-4493-a7b2-c08c070dba4f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:38.896608 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-37b1b61c-628e-4493-a7b2-c08c070dba4f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:38.903047 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-37b1b61c-628e-4493-a7b2-c08c070dba4f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:38.903534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-37b1b61c-628e-4493-a7b2-c08c070dba4f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:38.903967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-37b1b61c-628e-4493-a7b2-c08c070dba4f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:38.904650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-37b1b61c-628e-4493-a7b2-c08c070dba4f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:38.905107 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-37b1b61c-628e-4493-a7b2-c08c070dba4f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:38.905530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-37b1b61c-628e-4493-a7b2-c08c070dba4f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:39.031891 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-37b1b61c-628e-4493-a7b2-c08c070dba4f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:39.039527 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-37b1b61c-628e-4493-a7b2-c08c070dba4f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.147426 Sep 13 03:27:39.040092 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 355/680] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:38 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:39.520242 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c496127d-1a56-4886-bb17-b269b9287658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:39.520848 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c496127d-1a56-4886-bb17-b269b9287658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:39.527145 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c496127d-1a56-4886-bb17-b269b9287658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:39.527626 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c496127d-1a56-4886-bb17-b269b9287658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:39.528057 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c496127d-1a56-4886-bb17-b269b9287658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:39.528731 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c496127d-1a56-4886-bb17-b269b9287658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:39.529177 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c496127d-1a56-4886-bb17-b269b9287658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:39.529620 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c496127d-1a56-4886-bb17-b269b9287658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:39.655170 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c496127d-1a56-4886-bb17-b269b9287658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:39.663872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c496127d-1a56-4886-bb17-b269b9287658 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.147428 Sep 13 03:27:39.664434 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 326/681] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:39 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:40.062634 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f51edf20-c72c-4d14-85f1-3098b94a7ce3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:40.063249 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f51edf20-c72c-4d14-85f1-3098b94a7ce3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:40.069697 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f51edf20-c72c-4d14-85f1-3098b94a7ce3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:40.070181 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f51edf20-c72c-4d14-85f1-3098b94a7ce3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:40.070631 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f51edf20-c72c-4d14-85f1-3098b94a7ce3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:40.071560 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f51edf20-c72c-4d14-85f1-3098b94a7ce3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:40.071770 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f51edf20-c72c-4d14-85f1-3098b94a7ce3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:40.072194 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f51edf20-c72c-4d14-85f1-3098b94a7ce3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:40.202041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f51edf20-c72c-4d14-85f1-3098b94a7ce3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:40.210109 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f51edf20-c72c-4d14-85f1-3098b94a7ce3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.151449 Sep 13 03:27:40.210689 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 356/682] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:40 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:40.687612 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-cc2cc2fb-b939-42ef-b0f4-4f6f7ff1d37c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:40.688824 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-cc2cc2fb-b939-42ef-b0f4-4f6f7ff1d37c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:40.695141 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cc2cc2fb-b939-42ef-b0f4-4f6f7ff1d37c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:40.695629 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cc2cc2fb-b939-42ef-b0f4-4f6f7ff1d37c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:40.696066 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cc2cc2fb-b939-42ef-b0f4-4f6f7ff1d37c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:40.696755 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cc2cc2fb-b939-42ef-b0f4-4f6f7ff1d37c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:40.697207 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cc2cc2fb-b939-42ef-b0f4-4f6f7ff1d37c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:40.697630 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cc2cc2fb-b939-42ef-b0f4-4f6f7ff1d37c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:40.827385 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-cc2cc2fb-b939-42ef-b0f4-4f6f7ff1d37c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:40.835620 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-cc2cc2fb-b939-42ef-b0f4-4f6f7ff1d37c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.151933 Sep 13 03:27:40.836188 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 327/683] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:40 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:41.233177 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ba9b1037-b4da-44bb-ba4b-15b091ab7c7b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:41.233787 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ba9b1037-b4da-44bb-ba4b-15b091ab7c7b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:41.241022 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba9b1037-b4da-44bb-ba4b-15b091ab7c7b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:41.241516 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba9b1037-b4da-44bb-ba4b-15b091ab7c7b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:41.241961 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba9b1037-b4da-44bb-ba4b-15b091ab7c7b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:41.242685 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba9b1037-b4da-44bb-ba4b-15b091ab7c7b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:41.243147 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba9b1037-b4da-44bb-ba4b-15b091ab7c7b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:41.243574 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ba9b1037-b4da-44bb-ba4b-15b091ab7c7b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:41.370009 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ba9b1037-b4da-44bb-ba4b-15b091ab7c7b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:41.377627 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ba9b1037-b4da-44bb-ba4b-15b091ab7c7b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.148300 Sep 13 03:27:41.378199 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 357/684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:41 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:41.857748 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-58e70709-b475-4e53-88d3-64c13235f01b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:41.858380 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-58e70709-b475-4e53-88d3-64c13235f01b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:41.864653 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-58e70709-b475-4e53-88d3-64c13235f01b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:41.865135 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-58e70709-b475-4e53-88d3-64c13235f01b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:41.865567 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-58e70709-b475-4e53-88d3-64c13235f01b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:41.866247 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-58e70709-b475-4e53-88d3-64c13235f01b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:41.866767 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-58e70709-b475-4e53-88d3-64c13235f01b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:41.867172 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-58e70709-b475-4e53-88d3-64c13235f01b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:41.992435 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-58e70709-b475-4e53-88d3-64c13235f01b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:42.000525 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-58e70709-b475-4e53-88d3-64c13235f01b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.146613 Sep 13 03:27:42.001082 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 328/685] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:41 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:42.400815 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6bbccf75-834b-4ebd-9759-b3315bfa8a52 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:42.401423 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6bbccf75-834b-4ebd-9759-b3315bfa8a52 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:42.407698 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6bbccf75-834b-4ebd-9759-b3315bfa8a52 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:42.408177 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6bbccf75-834b-4ebd-9759-b3315bfa8a52 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:42.408610 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6bbccf75-834b-4ebd-9759-b3315bfa8a52 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:42.409286 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6bbccf75-834b-4ebd-9759-b3315bfa8a52 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:42.409736 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6bbccf75-834b-4ebd-9759-b3315bfa8a52 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:42.410162 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6bbccf75-834b-4ebd-9759-b3315bfa8a52 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:42.538872 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6bbccf75-834b-4ebd-9759-b3315bfa8a52 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:42.546665 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6bbccf75-834b-4ebd-9759-b3315bfa8a52 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.149733 Sep 13 03:27:42.547221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 358/686] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:42 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:43.024354 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7a4e6ac0-6cb9-4ead-89b6-f91f25806f46 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:43.024969 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7a4e6ac0-6cb9-4ead-89b6-f91f25806f46 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:43.031428 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7a4e6ac0-6cb9-4ead-89b6-f91f25806f46 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:43.031920 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7a4e6ac0-6cb9-4ead-89b6-f91f25806f46 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:43.032357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7a4e6ac0-6cb9-4ead-89b6-f91f25806f46 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:43.033047 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7a4e6ac0-6cb9-4ead-89b6-f91f25806f46 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:43.034116 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7a4e6ac0-6cb9-4ead-89b6-f91f25806f46 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:43.034542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7a4e6ac0-6cb9-4ead-89b6-f91f25806f46 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:43.163865 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7a4e6ac0-6cb9-4ead-89b6-f91f25806f46 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:43.172418 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7a4e6ac0-6cb9-4ead-89b6-f91f25806f46 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.151968 Sep 13 03:27:43.172982 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 329/687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:43 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:43.570187 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e674601c-8b49-4f00-a9f5-0773e092d7eb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:43.570827 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e674601c-8b49-4f00-a9f5-0773e092d7eb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:43.573365 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=42 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:27:43.578507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e674601c-8b49-4f00-a9f5-0773e092d7eb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:43.579011 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e674601c-8b49-4f00-a9f5-0773e092d7eb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:43.579442 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e674601c-8b49-4f00-a9f5-0773e092d7eb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:43.580817 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e674601c-8b49-4f00-a9f5-0773e092d7eb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:43.581285 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e674601c-8b49-4f00-a9f5-0773e092d7eb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:43.581688 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e674601c-8b49-4f00-a9f5-0773e092d7eb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:43.708350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e674601c-8b49-4f00-a9f5-0773e092d7eb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:43.716021 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e674601c-8b49-4f00-a9f5-0773e092d7eb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.149610 Sep 13 03:27:43.716580 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 359/688] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:43 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:44.195523 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d80a0e35-30b6-4c33-a050-491e87008010 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:44.196135 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d80a0e35-30b6-4c33-a050-491e87008010 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:44.202549 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d80a0e35-30b6-4c33-a050-491e87008010 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:44.203069 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d80a0e35-30b6-4c33-a050-491e87008010 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:44.203505 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d80a0e35-30b6-4c33-a050-491e87008010 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:44.204189 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d80a0e35-30b6-4c33-a050-491e87008010 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:44.204662 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d80a0e35-30b6-4c33-a050-491e87008010 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:44.205065 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d80a0e35-30b6-4c33-a050-491e87008010 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:44.335006 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d80a0e35-30b6-4c33-a050-491e87008010 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:44.343122 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d80a0e35-30b6-4c33-a050-491e87008010 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.151478 Sep 13 03:27:44.343682 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 330/689] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:44 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:44.739000 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-da90179c-8c7d-475c-9a9b-2e61370c45f7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:44.739610 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-da90179c-8c7d-475c-9a9b-2e61370c45f7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:44.745880 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-da90179c-8c7d-475c-9a9b-2e61370c45f7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:44.746358 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-da90179c-8c7d-475c-9a9b-2e61370c45f7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:44.746834 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-da90179c-8c7d-475c-9a9b-2e61370c45f7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:44.747512 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-da90179c-8c7d-475c-9a9b-2e61370c45f7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:44.747962 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-da90179c-8c7d-475c-9a9b-2e61370c45f7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:44.748397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-da90179c-8c7d-475c-9a9b-2e61370c45f7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:44.878805 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-da90179c-8c7d-475c-9a9b-2e61370c45f7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:44.886314 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-da90179c-8c7d-475c-9a9b-2e61370c45f7 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.151113 Sep 13 03:27:44.886904 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 360/690] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:44 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:45.366892 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d27ca71d-3b98-44af-9156-081ab3557b98 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:45.367427 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d27ca71d-3b98-44af-9156-081ab3557b98 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:45.369792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=46 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:27:45.374880 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d27ca71d-3b98-44af-9156-081ab3557b98 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:45.375366 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d27ca71d-3b98-44af-9156-081ab3557b98 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:45.375799 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d27ca71d-3b98-44af-9156-081ab3557b98 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:45.376485 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d27ca71d-3b98-44af-9156-081ab3557b98 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:45.377545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d27ca71d-3b98-44af-9156-081ab3557b98 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:45.377969 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d27ca71d-3b98-44af-9156-081ab3557b98 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:45.504739 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d27ca71d-3b98-44af-9156-081ab3557b98 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:45.512744 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d27ca71d-3b98-44af-9156-081ab3557b98 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.149796 Sep 13 03:27:45.513300 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 331/691] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:45 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:27:45.908992 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5cbad104-92df-4678-bbe1-e5ad8dde14f3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:45.909624 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5cbad104-92df-4678-bbe1-e5ad8dde14f3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:45.916229 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5cbad104-92df-4678-bbe1-e5ad8dde14f3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:45.916719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5cbad104-92df-4678-bbe1-e5ad8dde14f3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:45.917187 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5cbad104-92df-4678-bbe1-e5ad8dde14f3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:45.917886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5cbad104-92df-4678-bbe1-e5ad8dde14f3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:45.918342 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5cbad104-92df-4678-bbe1-e5ad8dde14f3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:45.918800 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5cbad104-92df-4678-bbe1-e5ad8dde14f3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:46.044304 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5cbad104-92df-4678-bbe1-e5ad8dde14f3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:46.052428 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5cbad104-92df-4678-bbe1-e5ad8dde14f3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.147322 Sep 13 03:27:46.052994 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 361/692] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:45 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:46.535412 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c2457139-3a95-494d-8d3e-1ac3f9c7cb90 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:46.535958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c2457139-3a95-494d-8d3e-1ac3f9c7cb90 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:46.542544 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2457139-3a95-494d-8d3e-1ac3f9c7cb90 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:46.543057 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2457139-3a95-494d-8d3e-1ac3f9c7cb90 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:46.543496 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2457139-3a95-494d-8d3e-1ac3f9c7cb90 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:46.544180 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2457139-3a95-494d-8d3e-1ac3f9c7cb90 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:46.544633 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2457139-3a95-494d-8d3e-1ac3f9c7cb90 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:46.545057 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2457139-3a95-494d-8d3e-1ac3f9c7cb90 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:46.674978 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c2457139-3a95-494d-8d3e-1ac3f9c7cb90 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:46.683066 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c2457139-3a95-494d-8d3e-1ac3f9c7cb90 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.151551 Sep 13 03:27:46.683627 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 332/693] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:46 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:47.075560 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a65e7c53-05af-4d20-9105-65da9382995d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:47.076198 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a65e7c53-05af-4d20-9105-65da9382995d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:47.082601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a65e7c53-05af-4d20-9105-65da9382995d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:47.083113 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a65e7c53-05af-4d20-9105-65da9382995d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:47.083547 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a65e7c53-05af-4d20-9105-65da9382995d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:47.084233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a65e7c53-05af-4d20-9105-65da9382995d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:47.084690 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a65e7c53-05af-4d20-9105-65da9382995d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:47.085112 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a65e7c53-05af-4d20-9105-65da9382995d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:47.216438 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a65e7c53-05af-4d20-9105-65da9382995d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:47.224700 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a65e7c53-05af-4d20-9105-65da9382995d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.152971 Sep 13 03:27:47.225261 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 362/694] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:47 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:47.707794 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e21f21ff-4751-43c6-990f-3a9be22cfecc tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:47.708405 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e21f21ff-4751-43c6-990f-3a9be22cfecc tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:47.714808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e21f21ff-4751-43c6-990f-3a9be22cfecc tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:47.715303 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e21f21ff-4751-43c6-990f-3a9be22cfecc tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:47.715748 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e21f21ff-4751-43c6-990f-3a9be22cfecc tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:47.716442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e21f21ff-4751-43c6-990f-3a9be22cfecc tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:47.716901 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e21f21ff-4751-43c6-990f-3a9be22cfecc tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:47.717329 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e21f21ff-4751-43c6-990f-3a9be22cfecc tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:47.844538 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-e21f21ff-4751-43c6-990f-3a9be22cfecc tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:47.852708 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e21f21ff-4751-43c6-990f-3a9be22cfecc tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.149508 Sep 13 03:27:47.853266 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 333/695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:47 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:48.247476 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a39de01c-4230-4f4c-8581-58eb230f3151 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:48.248085 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a39de01c-4230-4f4c-8581-58eb230f3151 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:48.255057 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a39de01c-4230-4f4c-8581-58eb230f3151 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:48.255544 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a39de01c-4230-4f4c-8581-58eb230f3151 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:48.255981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a39de01c-4230-4f4c-8581-58eb230f3151 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:48.256665 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a39de01c-4230-4f4c-8581-58eb230f3151 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:48.257121 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a39de01c-4230-4f4c-8581-58eb230f3151 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:48.257543 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a39de01c-4230-4f4c-8581-58eb230f3151 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:48.387615 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a39de01c-4230-4f4c-8581-58eb230f3151 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:48.395179 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a39de01c-4230-4f4c-8581-58eb230f3151 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.151492 Sep 13 03:27:48.395740 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 363/696] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:48 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:48.875598 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c5c4d099-a74c-48ee-9d78-9af6a958042f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:48.876205 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c5c4d099-a74c-48ee-9d78-9af6a958042f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:48.882870 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5c4d099-a74c-48ee-9d78-9af6a958042f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:48.883355 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5c4d099-a74c-48ee-9d78-9af6a958042f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:48.883785 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5c4d099-a74c-48ee-9d78-9af6a958042f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:48.884459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5c4d099-a74c-48ee-9d78-9af6a958042f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:48.884907 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5c4d099-a74c-48ee-9d78-9af6a958042f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:48.885322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5c4d099-a74c-48ee-9d78-9af6a958042f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:49.010600 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c5c4d099-a74c-48ee-9d78-9af6a958042f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:49.019981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c5c4d099-a74c-48ee-9d78-9af6a958042f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1736 microversion: 2.1 time: 0.148012 Sep 13 03:27:49.027303 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 334/697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:48 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:49.418345 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8c804da3-0eab-4cb5-95ea-aaacc97ce019 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:49.418915 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8c804da3-0eab-4cb5-95ea-aaacc97ce019 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:49.425327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8c804da3-0eab-4cb5-95ea-aaacc97ce019 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:49.425811 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8c804da3-0eab-4cb5-95ea-aaacc97ce019 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:49.426249 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8c804da3-0eab-4cb5-95ea-aaacc97ce019 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:49.426959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8c804da3-0eab-4cb5-95ea-aaacc97ce019 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:49.427412 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8c804da3-0eab-4cb5-95ea-aaacc97ce019 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:49.427834 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8c804da3-0eab-4cb5-95ea-aaacc97ce019 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:49.559468 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-8c804da3-0eab-4cb5-95ea-aaacc97ce019 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:49.567832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8c804da3-0eab-4cb5-95ea-aaacc97ce019 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.153666 Sep 13 03:27:49.568999 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 364/698] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:49 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:50.044136 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-22c6ab40-358c-4471-bb3d-5ea4c19f9d69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:50.044752 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-22c6ab40-358c-4471-bb3d-5ea4c19f9d69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:50.051792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22c6ab40-358c-4471-bb3d-5ea4c19f9d69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:50.052282 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22c6ab40-358c-4471-bb3d-5ea4c19f9d69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:50.052723 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22c6ab40-358c-4471-bb3d-5ea4c19f9d69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:50.053408 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22c6ab40-358c-4471-bb3d-5ea4c19f9d69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:50.053960 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22c6ab40-358c-4471-bb3d-5ea4c19f9d69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:50.054394 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22c6ab40-358c-4471-bb3d-5ea4c19f9d69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:50.182915 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-22c6ab40-358c-4471-bb3d-5ea4c19f9d69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:50.191056 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-22c6ab40-358c-4471-bb3d-5ea4c19f9d69 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1716 microversion: 2.1 time: 0.151056 Sep 13 03:27:50.191618 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 335/699] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:50 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:50.251966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8810bb7e-519c-4c67-8fa3-f5450cc20f04 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:50.252463 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8810bb7e-519c-4c67-8fa3-f5450cc20f04 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:50.254402 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 03:27:50.254534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Tue Sep 13 03:27:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments/ffa8ce3e-d612-48e7-9087-3c413ea0028c (ip 10.222.0.18) !!! Sep 13 03:27:50.261045 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8810bb7e-519c-4c67-8fa3-f5450cc20f04 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:50.261535 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8810bb7e-519c-4c67-8fa3-f5450cc20f04 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:50.261973 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8810bb7e-519c-4c67-8fa3-f5450cc20f04 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:50.262993 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8810bb7e-519c-4c67-8fa3-f5450cc20f04 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:50.263454 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8810bb7e-519c-4c67-8fa3-f5450cc20f04 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:50.263883 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8810bb7e-519c-4c67-8fa3-f5450cc20f04 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:50.386057 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-8810bb7e-519c-4c67-8fa3-f5450cc20f04 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] HTTP exception thrown: Cannot 'detach_volume' instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f while it is in vm_state rescued Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8810bb7e-519c-4c67-8fa3-f5450cc20f04 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Request method failure captured: Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: DELETE /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments/ffa8ce3e-d612-48e7-9087-3c413ea0028c HTTP/1.1 Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_ckfyr_FdMe7JDHHYQ02j3Yi-uV_C-rB4-EtATCIFXSBWLGGhu9M98PVZJquzMru2LcuccQVe7G9t8nFYxTH3gfXeSgkIQO_KMYHzhIs9bP_Y8CpAoG2B5UzUZ2HsrVN9VQy5PjeEaRinTvDlcb_cFRPIRwhk4q_eTKwpu_yzwcs8M Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 609f8dcac1034d09a04192f4238b2857 Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:27:50.387696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:27:50.389270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/609f8dcac1034d09a04192f4238b2857"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_609f8dcac1034d09a04192f4238b2857", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/609f8dcac1034d09a04192f4238b2857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/609f8dcac1034d09a04192f4238b2857"}]}] Sep 13 03:27:50.389270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:27:50.389270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 609f8dcac1034d09a04192f4238b2857 Sep 13 03:27:50.389270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:27:50.389270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-ServerRescueNegativeTestJSON-1628822356-project Sep 13 03:27:50.389270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:27:50.389270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:27:50.389270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: b85258f01e1f436585eb6b9a4f3813b8 Sep 13 03:27:50.389270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1628822356-project Sep 13 03:27:50.389270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:27:50.389270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Cannot 'detach_volume' instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f while it is in vm_state rescued Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'server_id': '3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f', 'id': 'ffa8ce3e-d612-48e7-9087-3c413ea0028c'} Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:27:50.390091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f while it is in vm_state rescued Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f while it is in vm_state rescued Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:27:50.391607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8810bb7e-519c-4c67-8fa3-f5450cc20f04 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Returning 409 to user: Cannot 'detach_volume' instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f while it is in vm_state rescued {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:27:50.393380 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8810bb7e-519c-4c67-8fa3-f5450cc20f04 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments/ffa8ce3e-d612-48e7-9087-3c413ea0028c" status: 409 len: 152 microversion: 2.1 time: 0.141128 Sep 13 03:27:50.393380 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 365/700] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 03:27:50 2022] DELETE /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments/ffa8ce3e-d612-48e7-9087-3c413ea0028c => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 13 03:27:50.398543 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ee0e170b-8498-4ea1-8fbd-2918aaa99ebe tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:27:50.399097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ee0e170b-8498-4ea1-8fbd-2918aaa99ebe tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:50.404854 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ee0e170b-8498-4ea1-8fbd-2918aaa99ebe tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:50.405333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ee0e170b-8498-4ea1-8fbd-2918aaa99ebe tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:50.405763 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ee0e170b-8498-4ea1-8fbd-2918aaa99ebe tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:50.406446 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ee0e170b-8498-4ea1-8fbd-2918aaa99ebe tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:50.406916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ee0e170b-8498-4ea1-8fbd-2918aaa99ebe tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:50.407332 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ee0e170b-8498-4ea1-8fbd-2918aaa99ebe tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:50.478980 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ee0e170b-8498-4ea1-8fbd-2918aaa99ebe tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "POST /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/action" status: 202 len: 0 microversion: 2.1 time: 0.083936 Sep 13 03:27:50.479540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 336/701] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:27:50 2022] POST /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:27:50.488458 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-65486139-5325-4dea-ab86-6ce92a0f5bc4 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:50.489064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-65486139-5325-4dea-ab86-6ce92a0f5bc4 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:50.495912 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-65486139-5325-4dea-ab86-6ce92a0f5bc4 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:50.496496 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-65486139-5325-4dea-ab86-6ce92a0f5bc4 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:50.496936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-65486139-5325-4dea-ab86-6ce92a0f5bc4 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:50.497740 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-65486139-5325-4dea-ab86-6ce92a0f5bc4 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:50.498827 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-65486139-5325-4dea-ab86-6ce92a0f5bc4 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:50.499276 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-65486139-5325-4dea-ab86-6ce92a0f5bc4 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:50.516841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:27:50.595228 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-fcccf6d6-5ebf-4ab7-be03-d7c495704657 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:50.596583 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-fcccf6d6-5ebf-4ab7-be03-d7c495704657 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:50.602597 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fcccf6d6-5ebf-4ab7-be03-d7c495704657 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:50.603117 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fcccf6d6-5ebf-4ab7-be03-d7c495704657 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:50.603556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fcccf6d6-5ebf-4ab7-be03-d7c495704657 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:50.604255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fcccf6d6-5ebf-4ab7-be03-d7c495704657 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:50.604711 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fcccf6d6-5ebf-4ab7-be03-d7c495704657 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:50.605138 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fcccf6d6-5ebf-4ab7-be03-d7c495704657 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:50.631446 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-65486139-5325-4dea-ab86-6ce92a0f5bc4 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:50.639807 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-65486139-5325-4dea-ab86-6ce92a0f5bc4 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1724 microversion: 2.1 time: 0.155902 Sep 13 03:27:50.640365 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 366/702] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:50 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:50.735614 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-fcccf6d6-5ebf-4ab7-be03-d7c495704657 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:50.743306 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-fcccf6d6-5ebf-4ab7-be03-d7c495704657 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.152327 Sep 13 03:27:50.743877 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 337/703] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:50 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:51.663322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e695d00c-8041-4c88-9ef1-edb517fc7253 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:51.663950 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e695d00c-8041-4c88-9ef1-edb517fc7253 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:51.670690 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e695d00c-8041-4c88-9ef1-edb517fc7253 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:51.671179 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e695d00c-8041-4c88-9ef1-edb517fc7253 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:51.671619 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e695d00c-8041-4c88-9ef1-edb517fc7253 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:51.672306 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e695d00c-8041-4c88-9ef1-edb517fc7253 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:51.672762 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e695d00c-8041-4c88-9ef1-edb517fc7253 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:51.673191 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e695d00c-8041-4c88-9ef1-edb517fc7253 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:51.765852 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-19d414cc-5e47-4086-bf0e-0ad04c96dcf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:51.767073 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-19d414cc-5e47-4086-bf0e-0ad04c96dcf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:51.773441 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19d414cc-5e47-4086-bf0e-0ad04c96dcf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:51.773923 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19d414cc-5e47-4086-bf0e-0ad04c96dcf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:51.774351 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19d414cc-5e47-4086-bf0e-0ad04c96dcf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:51.775058 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19d414cc-5e47-4086-bf0e-0ad04c96dcf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:51.775507 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19d414cc-5e47-4086-bf0e-0ad04c96dcf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:51.775924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19d414cc-5e47-4086-bf0e-0ad04c96dcf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:51.779921 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:27:51.808240 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e695d00c-8041-4c88-9ef1-edb517fc7253 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:51.816456 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e695d00c-8041-4c88-9ef1-edb517fc7253 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1724 microversion: 2.1 time: 0.157109 Sep 13 03:27:51.817024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 367/704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:51 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:51.908663 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-19d414cc-5e47-4086-bf0e-0ad04c96dcf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:51.916568 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-19d414cc-5e47-4086-bf0e-0ad04c96dcf1 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.154548 Sep 13 03:27:51.917087 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 338/705] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:51 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:27:52.840040 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a6b2ea67-4da3-4c44-bb2a-ca92737b6c85 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:52.840644 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a6b2ea67-4da3-4c44-bb2a-ca92737b6c85 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:52.846899 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6b2ea67-4da3-4c44-bb2a-ca92737b6c85 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:52.847385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6b2ea67-4da3-4c44-bb2a-ca92737b6c85 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:52.847815 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6b2ea67-4da3-4c44-bb2a-ca92737b6c85 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:52.848491 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6b2ea67-4da3-4c44-bb2a-ca92737b6c85 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:52.848937 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6b2ea67-4da3-4c44-bb2a-ca92737b6c85 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:52.849354 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6b2ea67-4da3-4c44-bb2a-ca92737b6c85 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:52.938743 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6480156b-5f1e-468b-8f5a-2b78640bbbfd tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:52.939933 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6480156b-5f1e-468b-8f5a-2b78640bbbfd tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:52.946431 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6480156b-5f1e-468b-8f5a-2b78640bbbfd tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:52.946881 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6480156b-5f1e-468b-8f5a-2b78640bbbfd tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:52.947317 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6480156b-5f1e-468b-8f5a-2b78640bbbfd tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:52.948008 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6480156b-5f1e-468b-8f5a-2b78640bbbfd tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:52.948458 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6480156b-5f1e-468b-8f5a-2b78640bbbfd tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:52.948884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6480156b-5f1e-468b-8f5a-2b78640bbbfd tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:52.977344 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a6b2ea67-4da3-4c44-bb2a-ca92737b6c85 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:52.985510 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a6b2ea67-4da3-4c44-bb2a-ca92737b6c85 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1724 microversion: 2.1 time: 0.149226 Sep 13 03:27:52.986719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 368/706] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:52 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:53.075648 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-6480156b-5f1e-468b-8f5a-2b78640bbbfd tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:53.083203 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6480156b-5f1e-468b-8f5a-2b78640bbbfd tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1677 microversion: 2.1 time: 0.148378 Sep 13 03:27:53.083773 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 339/707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:52 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:27:54.008738 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-60c360e4-344c-4f34-a7e1-28d4b8a8321c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:54.009345 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-60c360e4-344c-4f34-a7e1-28d4b8a8321c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:54.015607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60c360e4-344c-4f34-a7e1-28d4b8a8321c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:54.016118 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60c360e4-344c-4f34-a7e1-28d4b8a8321c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:54.016550 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60c360e4-344c-4f34-a7e1-28d4b8a8321c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:54.017315 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60c360e4-344c-4f34-a7e1-28d4b8a8321c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:54.018447 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60c360e4-344c-4f34-a7e1-28d4b8a8321c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:54.018922 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60c360e4-344c-4f34-a7e1-28d4b8a8321c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:54.106762 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-be038993-3327-4cd8-8cad-19e76069b352 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:54.107525 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-be038993-3327-4cd8-8cad-19e76069b352 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:54.115543 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-be038993-3327-4cd8-8cad-19e76069b352 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:54.116137 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-be038993-3327-4cd8-8cad-19e76069b352 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:54.116646 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-be038993-3327-4cd8-8cad-19e76069b352 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:54.117347 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-be038993-3327-4cd8-8cad-19e76069b352 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:54.117805 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-be038993-3327-4cd8-8cad-19e76069b352 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:54.118225 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-be038993-3327-4cd8-8cad-19e76069b352 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:54.152212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-60c360e4-344c-4f34-a7e1-28d4b8a8321c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:54.160679 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-60c360e4-344c-4f34-a7e1-28d4b8a8321c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1724 microversion: 2.1 time: 0.155710 Sep 13 03:27:54.161238 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 369/708] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:54 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:54.253150 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-be038993-3327-4cd8-8cad-19e76069b352 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:54.260839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-be038993-3327-4cd8-8cad-19e76069b352 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1654 microversion: 2.1 time: 0.158130 Sep 13 03:27:54.261341 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 340/709] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:54 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:27:54.282991 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f894fdac-c24c-4ea0-9750-053d68f5d7a5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:27:54.288780 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f894fdac-c24c-4ea0-9750-053d68f5d7a5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:54.289270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f894fdac-c24c-4ea0-9750-053d68f5d7a5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:54.289713 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f894fdac-c24c-4ea0-9750-053d68f5d7a5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:54.312302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f894fdac-c24c-4ea0-9750-053d68f5d7a5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Going to try to start instance {{(pid=120383) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 03:27:54.351824 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f894fdac-c24c-4ea0-9750-053d68f5d7a5 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "POST /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/action" status: 202 len: 0 microversion: 2.1 time: 0.072635 Sep 13 03:27:54.352404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 370/710] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:27:54 2022] POST /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 03:27:54.360387 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ff452bc5-ede6-498e-a1b0-0ac496940075 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:54.361524 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ff452bc5-ede6-498e-a1b0-0ac496940075 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:54.367403 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ff452bc5-ede6-498e-a1b0-0ac496940075 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:54.367881 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ff452bc5-ede6-498e-a1b0-0ac496940075 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:54.368308 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ff452bc5-ede6-498e-a1b0-0ac496940075 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:54.368986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ff452bc5-ede6-498e-a1b0-0ac496940075 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:54.369432 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ff452bc5-ede6-498e-a1b0-0ac496940075 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:54.369852 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ff452bc5-ede6-498e-a1b0-0ac496940075 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:54.494930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ff452bc5-ede6-498e-a1b0-0ac496940075 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:54.502565 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ff452bc5-ede6-498e-a1b0-0ac496940075 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1663 microversion: 2.1 time: 0.145934 Sep 13 03:27:54.503160 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 341/711] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:54 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1663 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:55.185134 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-65ba27bd-535a-40c3-8e9c-82a66ee6e21c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:55.185829 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-65ba27bd-535a-40c3-8e9c-82a66ee6e21c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:55.192343 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-65ba27bd-535a-40c3-8e9c-82a66ee6e21c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:55.192823 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-65ba27bd-535a-40c3-8e9c-82a66ee6e21c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:55.193255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-65ba27bd-535a-40c3-8e9c-82a66ee6e21c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:55.193934 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-65ba27bd-535a-40c3-8e9c-82a66ee6e21c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:55.194383 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-65ba27bd-535a-40c3-8e9c-82a66ee6e21c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:55.194836 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-65ba27bd-535a-40c3-8e9c-82a66ee6e21c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:55.385393 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-65ba27bd-535a-40c3-8e9c-82a66ee6e21c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:55.394147 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-65ba27bd-535a-40c3-8e9c-82a66ee6e21c tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1730 microversion: 2.1 time: 0.213724 Sep 13 03:27:55.395061 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 371/712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:55 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:55.416896 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-38e9becc-fdaa-4b5a-a87d-bae10fdfc021 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:55.417429 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-38e9becc-fdaa-4b5a-a87d-bae10fdfc021 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:55.423738 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38e9becc-fdaa-4b5a-a87d-bae10fdfc021 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:55.424230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38e9becc-fdaa-4b5a-a87d-bae10fdfc021 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:55.424667 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38e9becc-fdaa-4b5a-a87d-bae10fdfc021 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:55.425357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38e9becc-fdaa-4b5a-a87d-bae10fdfc021 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:55.425811 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38e9becc-fdaa-4b5a-a87d-bae10fdfc021 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:55.426236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38e9becc-fdaa-4b5a-a87d-bae10fdfc021 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:55.503841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-38e9becc-fdaa-4b5a-a87d-bae10fdfc021 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091130 Sep 13 03:27:55.504439 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 342/713] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 03:27:55 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:27:55.524980 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-49a6fa34-ff30-4a4b-b6da-93afc4b1876d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:55.525587 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-49a6fa34-ff30-4a4b-b6da-93afc4b1876d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:55.531457 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-49a6fa34-ff30-4a4b-b6da-93afc4b1876d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:55.531945 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-49a6fa34-ff30-4a4b-b6da-93afc4b1876d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:55.532375 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-49a6fa34-ff30-4a4b-b6da-93afc4b1876d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:55.533110 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-49a6fa34-ff30-4a4b-b6da-93afc4b1876d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:55.533559 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-49a6fa34-ff30-4a4b-b6da-93afc4b1876d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:55.533975 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-49a6fa34-ff30-4a4b-b6da-93afc4b1876d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:55.741951 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-49a6fa34-ff30-4a4b-b6da-93afc4b1876d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:55.749687 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-49a6fa34-ff30-4a4b-b6da-93afc4b1876d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1663 microversion: 2.1 time: 0.228479 Sep 13 03:27:55.750259 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 372/714] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:55 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1663 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:56.391517 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-b0b1a3b1-bcd0-4875-9258-6efca88b11b0 req-972373f1-28a5-4322-9df5-a322cea0bb5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f", "tag": "7cf9530c-a7c2-4a93-8567-f2298a93d7de"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:27:56.401661 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-b0b1a3b1-bcd0-4875-9258-6efca88b11b0 req-972373f1-28a5-4322-9df5-a322cea0bb5d service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:56.402138 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-b0b1a3b1-bcd0-4875-9258-6efca88b11b0 req-972373f1-28a5-4322-9df5-a322cea0bb5d service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:56.402563 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-b0b1a3b1-bcd0-4875-9258-6efca88b11b0 req-972373f1-28a5-4322-9df5-a322cea0bb5d service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:56.414107 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-b0b1a3b1-bcd0-4875-9258-6efca88b11b0 req-972373f1-28a5-4322-9df5-a322cea0bb5d service nova] Creating event network-changed:7cf9530c-a7c2-4a93-8567-f2298a93d7de for instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f on hv-cinder-85707 Sep 13 03:27:56.419223 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-b0b1a3b1-bcd0-4875-9258-6efca88b11b0 req-972373f1-28a5-4322-9df5-a322cea0bb5d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032057 Sep 13 03:27:56.420132 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 343/715] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:27:56.773964 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-06acadaf-c6d0-4663-9bce-46d416ac6d67 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:27:56.774588 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-06acadaf-c6d0-4663-9bce-46d416ac6d67 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:27:56.781057 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06acadaf-c6d0-4663-9bce-46d416ac6d67 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:56.781546 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06acadaf-c6d0-4663-9bce-46d416ac6d67 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:56.781981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06acadaf-c6d0-4663-9bce-46d416ac6d67 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:56.782699 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06acadaf-c6d0-4663-9bce-46d416ac6d67 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:56.783160 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06acadaf-c6d0-4663-9bce-46d416ac6d67 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:56.783584 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06acadaf-c6d0-4663-9bce-46d416ac6d67 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:56.930489 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-06acadaf-c6d0-4663-9bce-46d416ac6d67 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:27:56.939968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-06acadaf-c6d0-4663-9bce-46d416ac6d67 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1667 microversion: 2.1 time: 0.169055 Sep 13 03:27:56.940511 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 373/716] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:27:56 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1667 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:27:58.434914 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-d6e444b0-888b-4e3b-a842-71bd9e4fc226 req-cce7f01e-d72d-49e0-a622-2a4ed87daeb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f", "tag": "7cf9530c-a7c2-4a93-8567-f2298a93d7de"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:27:58.444820 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-d6e444b0-888b-4e3b-a842-71bd9e4fc226 req-cce7f01e-d72d-49e0-a622-2a4ed87daeb2 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:27:58.445677 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-d6e444b0-888b-4e3b-a842-71bd9e4fc226 req-cce7f01e-d72d-49e0-a622-2a4ed87daeb2 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:27:58.446141 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-d6e444b0-888b-4e3b-a842-71bd9e4fc226 req-cce7f01e-d72d-49e0-a622-2a4ed87daeb2 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:27:58.457128 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-d6e444b0-888b-4e3b-a842-71bd9e4fc226 req-cce7f01e-d72d-49e0-a622-2a4ed87daeb2 service nova] Creating event network-changed:7cf9530c-a7c2-4a93-8567-f2298a93d7de for instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f on hv-cinder-85707 Sep 13 03:27:58.461807 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-d6e444b0-888b-4e3b-a842-71bd9e4fc226 req-cce7f01e-d72d-49e0-a622-2a4ed87daeb2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031426 Sep 13 03:27:58.462370 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 344/717] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:28:10.567634 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3b90b82c-81b2-450d-92af-bb63f4024e61 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:10.568232 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3b90b82c-81b2-450d-92af-bb63f4024e61 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:10.570923 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=29 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:10.571568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:10.578318 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3b90b82c-81b2-450d-92af-bb63f4024e61 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:10.578825 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3b90b82c-81b2-450d-92af-bb63f4024e61 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:10.579259 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3b90b82c-81b2-450d-92af-bb63f4024e61 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:10.580435 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3b90b82c-81b2-450d-92af-bb63f4024e61 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:10.580887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3b90b82c-81b2-450d-92af-bb63f4024e61 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:10.581316 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3b90b82c-81b2-450d-92af-bb63f4024e61 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:10.604398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-3b90b82c-81b2-450d-92af-bb63f4024e61 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lazy-loading 'flavor' on Instance uuid aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:28:10.672519 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3b90b82c-81b2-450d-92af-bb63f4024e61 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "POST /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6/action" status: 202 len: 0 microversion: 2.1 time: 0.108565 Sep 13 03:28:10.673088 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 374/718] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:28:10 2022] POST /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:28:10.679275 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=27 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:10.680110 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=30 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:10.684764 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5a70cd95-6f9f-4866-afb1-61feb840478a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:10.686099 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5a70cd95-6f9f-4866-afb1-61feb840478a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:10.692841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a70cd95-6f9f-4866-afb1-61feb840478a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:10.693388 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a70cd95-6f9f-4866-afb1-61feb840478a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:10.693869 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a70cd95-6f9f-4866-afb1-61feb840478a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:10.694637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a70cd95-6f9f-4866-afb1-61feb840478a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:10.695335 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a70cd95-6f9f-4866-afb1-61feb840478a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:10.695855 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5a70cd95-6f9f-4866-afb1-61feb840478a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:10.830550 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5a70cd95-6f9f-4866-afb1-61feb840478a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:10.838644 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5a70cd95-6f9f-4866-afb1-61feb840478a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.161026 Sep 13 03:28:10.839210 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 345/719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:10 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:11.862819 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7fc217f3-4e5b-4c23-8519-e4d4024aeee9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:11.863534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7fc217f3-4e5b-4c23-8519-e4d4024aeee9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:11.869616 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7fc217f3-4e5b-4c23-8519-e4d4024aeee9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:11.870094 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7fc217f3-4e5b-4c23-8519-e4d4024aeee9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:11.870525 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7fc217f3-4e5b-4c23-8519-e4d4024aeee9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:11.871247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7fc217f3-4e5b-4c23-8519-e4d4024aeee9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:11.871692 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7fc217f3-4e5b-4c23-8519-e4d4024aeee9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:11.872104 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7fc217f3-4e5b-4c23-8519-e4d4024aeee9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:12.000777 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7fc217f3-4e5b-4c23-8519-e4d4024aeee9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:12.008899 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7fc217f3-4e5b-4c23-8519-e4d4024aeee9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.151319 Sep 13 03:28:12.009450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 375/720] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:11 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:13.031511 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b7a9d825-f6b8-4fb2-8bc4-581248ff46cf tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:13.032122 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b7a9d825-f6b8-4fb2-8bc4-581248ff46cf tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:13.038628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b7a9d825-f6b8-4fb2-8bc4-581248ff46cf tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:13.039132 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b7a9d825-f6b8-4fb2-8bc4-581248ff46cf tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:13.039571 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b7a9d825-f6b8-4fb2-8bc4-581248ff46cf tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:13.040504 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b7a9d825-f6b8-4fb2-8bc4-581248ff46cf tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:13.040972 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b7a9d825-f6b8-4fb2-8bc4-581248ff46cf tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:13.041398 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b7a9d825-f6b8-4fb2-8bc4-581248ff46cf tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:13.172528 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b7a9d825-f6b8-4fb2-8bc4-581248ff46cf tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:13.180707 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b7a9d825-f6b8-4fb2-8bc4-581248ff46cf tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.153030 Sep 13 03:28:13.181261 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 346/721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:13 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:14.202692 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c6824e4d-25a4-44ed-86be-e056c240ade5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:14.203305 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c6824e4d-25a4-44ed-86be-e056c240ade5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:14.210201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6824e4d-25a4-44ed-86be-e056c240ade5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:14.210819 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6824e4d-25a4-44ed-86be-e056c240ade5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:14.211262 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6824e4d-25a4-44ed-86be-e056c240ade5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:14.211945 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6824e4d-25a4-44ed-86be-e056c240ade5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:14.212427 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6824e4d-25a4-44ed-86be-e056c240ade5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:14.212851 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6824e4d-25a4-44ed-86be-e056c240ade5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:14.343943 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c6824e4d-25a4-44ed-86be-e056c240ade5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:14.351647 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c6824e4d-25a4-44ed-86be-e056c240ade5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.152797 Sep 13 03:28:14.352214 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 376/722] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:14 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:15.374537 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-97426f6e-ab46-4651-acdd-78488f9602c8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:15.375111 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-97426f6e-ab46-4651-acdd-78488f9602c8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:15.381697 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-97426f6e-ab46-4651-acdd-78488f9602c8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:15.382349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-97426f6e-ab46-4651-acdd-78488f9602c8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:15.382835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-97426f6e-ab46-4651-acdd-78488f9602c8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:15.383525 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-97426f6e-ab46-4651-acdd-78488f9602c8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:15.383983 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-97426f6e-ab46-4651-acdd-78488f9602c8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:15.384408 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-97426f6e-ab46-4651-acdd-78488f9602c8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:15.512442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-97426f6e-ab46-4651-acdd-78488f9602c8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:15.520835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-97426f6e-ab46-4651-acdd-78488f9602c8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.150335 Sep 13 03:28:15.521410 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 347/723] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:15 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:16.543068 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7c959785-7287-4427-b793-014a044f4b07 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:16.543717 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7c959785-7287-4427-b793-014a044f4b07 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:16.549908 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7c959785-7287-4427-b793-014a044f4b07 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:16.550387 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7c959785-7287-4427-b793-014a044f4b07 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:16.550856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7c959785-7287-4427-b793-014a044f4b07 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:16.551542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7c959785-7287-4427-b793-014a044f4b07 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:16.551989 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7c959785-7287-4427-b793-014a044f4b07 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:16.552405 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7c959785-7287-4427-b793-014a044f4b07 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:16.678423 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7c959785-7287-4427-b793-014a044f4b07 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:16.685952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7c959785-7287-4427-b793-014a044f4b07 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.147038 Sep 13 03:28:16.686506 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 377/724] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:16 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:17.709491 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3eef54bd-95a9-4787-9663-bb16164bdafe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:17.710110 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3eef54bd-95a9-4787-9663-bb16164bdafe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:17.719231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3eef54bd-95a9-4787-9663-bb16164bdafe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:17.720138 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3eef54bd-95a9-4787-9663-bb16164bdafe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:17.720953 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3eef54bd-95a9-4787-9663-bb16164bdafe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:17.722212 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3eef54bd-95a9-4787-9663-bb16164bdafe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:17.723103 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3eef54bd-95a9-4787-9663-bb16164bdafe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:17.723808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3eef54bd-95a9-4787-9663-bb16164bdafe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:17.853252 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3eef54bd-95a9-4787-9663-bb16164bdafe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:17.860945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3eef54bd-95a9-4787-9663-bb16164bdafe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.155816 Sep 13 03:28:17.861530 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 348/725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:17 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:18.059193 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-03ef609d-e4ed-4057-b705-6329098d215b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:18.059796 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-03ef609d-e4ed-4057-b705-6329098d215b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:18.066767 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-03ef609d-e4ed-4057-b705-6329098d215b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:18.067868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-03ef609d-e4ed-4057-b705-6329098d215b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:18.068305 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-03ef609d-e4ed-4057-b705-6329098d215b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:18.069011 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-03ef609d-e4ed-4057-b705-6329098d215b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:18.069508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-03ef609d-e4ed-4057-b705-6329098d215b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:18.069884 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-03ef609d-e4ed-4057-b705-6329098d215b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:18.092617 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-03ef609d-e4ed-4057-b705-6329098d215b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457/ips" status: 200 len: 150 microversion: 2.1 time: 0.037292 Sep 13 03:28:18.093176 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 378/726] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 03:28:18 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:28:18.104772 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8190ff28-8c39-454c-af6f-eb0a3ce5f0e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d043ba5-31f8-4fac-8514-c63d892ce155"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:18.107140 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8190ff28-8c39-454c-af6f-eb0a3ce5f0e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:18.112954 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8190ff28-8c39-454c-af6f-eb0a3ce5f0e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:18.113445 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8190ff28-8c39-454c-af6f-eb0a3ce5f0e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:18.114374 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8190ff28-8c39-454c-af6f-eb0a3ce5f0e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:18.115093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8190ff28-8c39-454c-af6f-eb0a3ce5f0e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:18.115553 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8190ff28-8c39-454c-af6f-eb0a3ce5f0e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:18.115981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8190ff28-8c39-454c-af6f-eb0a3ce5f0e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:18.195740 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-8190ff28-8c39-454c-af6f-eb0a3ce5f0e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Invalid volume: volume 9d043ba5-31f8-4fac-8514-c63d892ce155 is already attached to instances: dab865ad-8ee0-4def-a996-caa5e4e30f30 Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8190ff28-8c39-454c-af6f-eb0a3ce5f0e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: POST /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457/os-volume_attachments HTTP/1.1 Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 74 Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:28:18.197453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:28:18.199115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:28:18.199115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:28:18.199115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:28:18.199115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:28:18.199115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:28:18.199115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:28:18.199115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:28:18.199115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:28:18.199115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:28:18.199115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Sep 13 03:28:18.199115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {"volumeAttachment": {"volumeId": "9d043ba5-31f8-4fac-8514-c63d892ce155"}} Sep 13 03:28:18.199115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Invalid volume: volume 9d043ba5-31f8-4fac-8514-c63d892ce155 is already attached to instances: dab865ad-8ee0-4def-a996-caa5e4e30f30 Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'server_id': '2620476c-6af0-419c-9d61-aeb1d1ee1457', 'body': {'volumeAttachment': {'volumeId': '9d043ba5-31f8-4fac-8514-c63d892ce155'}}} Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9d043ba5-31f8-4fac-8514-c63d892ce155 is already attached to instances: dab865ad-8ee0-4def-a996-caa5e4e30f30 Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:18.200098 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9d043ba5-31f8-4fac-8514-c63d892ce155 is already attached to instances: dab865ad-8ee0-4def-a996-caa5e4e30f30 Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:28:18.201610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:28:18.203209 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:28:18.203209 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:28:18.203209 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:28:18.203209 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9d043ba5-31f8-4fac-8514-c63d892ce155 is already attached to instances: dab865ad-8ee0-4def-a996-caa5e4e30f30 Sep 13 03:28:18.203209 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:18.203209 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8190ff28-8c39-454c-af6f-eb0a3ce5f0e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 400 to user: Invalid volume: volume 9d043ba5-31f8-4fac-8514-c63d892ce155 is already attached to instances: dab865ad-8ee0-4def-a996-caa5e4e30f30 {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:28:18.203209 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8190ff28-8c39-454c-af6f-eb0a3ce5f0e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098224 Sep 13 03:28:18.203209 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 349/727] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:28:18 2022] POST /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 03:28:18.207900 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e4179031-5dac-4618-a7d1-953a54bb01e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:18.208397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e4179031-5dac-4618-a7d1-953a54bb01e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:18.214302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e4179031-5dac-4618-a7d1-953a54bb01e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:18.214836 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e4179031-5dac-4618-a7d1-953a54bb01e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:18.215280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e4179031-5dac-4618-a7d1-953a54bb01e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:18.215969 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e4179031-5dac-4618-a7d1-953a54bb01e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:18.216428 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e4179031-5dac-4618-a7d1-953a54bb01e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:18.216858 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e4179031-5dac-4618-a7d1-953a54bb01e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:18.241387 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e4179031-5dac-4618-a7d1-953a54bb01e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Going to try to terminate instance {{(pid=120383) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:28:18.318260 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e4179031-5dac-4618-a7d1-953a54bb01e6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 204 len: 0 microversion: 2.1 time: 0.113073 Sep 13 03:28:18.319142 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 379/728] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:28:18 2022] DELETE /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:28:18.327732 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f7bb28fd-eab5-44f3-8241-b1bfebf6041a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:18.328404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f7bb28fd-eab5-44f3-8241-b1bfebf6041a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:18.335134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7bb28fd-eab5-44f3-8241-b1bfebf6041a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:18.335622 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7bb28fd-eab5-44f3-8241-b1bfebf6041a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:18.336089 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7bb28fd-eab5-44f3-8241-b1bfebf6041a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:18.336779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7bb28fd-eab5-44f3-8241-b1bfebf6041a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:18.337238 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7bb28fd-eab5-44f3-8241-b1bfebf6041a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:18.337669 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7bb28fd-eab5-44f3-8241-b1bfebf6041a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:18.469160 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f7bb28fd-eab5-44f3-8241-b1bfebf6041a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:18.476710 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f7bb28fd-eab5-44f3-8241-b1bfebf6041a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1682 microversion: 2.1 time: 0.153053 Sep 13 03:28:18.477270 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 350/729] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:18 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:18.884804 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4129f0ff-237f-4080-b320-9066eefd645e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:18.885534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4129f0ff-237f-4080-b320-9066eefd645e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:18.891399 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4129f0ff-237f-4080-b320-9066eefd645e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:18.891886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4129f0ff-237f-4080-b320-9066eefd645e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:18.892321 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4129f0ff-237f-4080-b320-9066eefd645e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:18.893012 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4129f0ff-237f-4080-b320-9066eefd645e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:18.893469 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4129f0ff-237f-4080-b320-9066eefd645e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:18.893894 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4129f0ff-237f-4080-b320-9066eefd645e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:19.024782 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4129f0ff-237f-4080-b320-9066eefd645e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:19.032465 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4129f0ff-237f-4080-b320-9066eefd645e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.151867 Sep 13 03:28:19.033046 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 380/730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:18 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:28:19.499573 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-fad8641b-3a66-4c06-8204-cf2223ea67cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:19.500168 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-fad8641b-3a66-4c06-8204-cf2223ea67cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:19.507233 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fad8641b-3a66-4c06-8204-cf2223ea67cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:19.507714 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fad8641b-3a66-4c06-8204-cf2223ea67cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:19.508144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fad8641b-3a66-4c06-8204-cf2223ea67cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:19.508818 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fad8641b-3a66-4c06-8204-cf2223ea67cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:19.509265 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fad8641b-3a66-4c06-8204-cf2223ea67cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:19.509680 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fad8641b-3a66-4c06-8204-cf2223ea67cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:19.635932 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-fad8641b-3a66-4c06-8204-cf2223ea67cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:19.643465 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-fad8641b-3a66-4c06-8204-cf2223ea67cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1682 microversion: 2.1 time: 0.147763 Sep 13 03:28:19.644023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 351/731] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:19 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:20.057005 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b2dbd07e-2682-4bd4-8822-01d751741b52 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:20.057616 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b2dbd07e-2682-4bd4-8822-01d751741b52 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:20.064033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2dbd07e-2682-4bd4-8822-01d751741b52 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:20.064512 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2dbd07e-2682-4bd4-8822-01d751741b52 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:20.064942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2dbd07e-2682-4bd4-8822-01d751741b52 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:20.065635 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2dbd07e-2682-4bd4-8822-01d751741b52 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:20.066082 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2dbd07e-2682-4bd4-8822-01d751741b52 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:20.066501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2dbd07e-2682-4bd4-8822-01d751741b52 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:20.196106 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b2dbd07e-2682-4bd4-8822-01d751741b52 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:20.203761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b2dbd07e-2682-4bd4-8822-01d751741b52 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.150601 Sep 13 03:28:20.204321 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 381/732] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:20 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:20.666937 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c9c42fbe-5c56-4a62-883b-05770f1b73cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:20.667691 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c9c42fbe-5c56-4a62-883b-05770f1b73cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:20.673952 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c9c42fbe-5c56-4a62-883b-05770f1b73cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:20.674438 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c9c42fbe-5c56-4a62-883b-05770f1b73cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:20.674905 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c9c42fbe-5c56-4a62-883b-05770f1b73cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:20.675623 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c9c42fbe-5c56-4a62-883b-05770f1b73cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:20.676698 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c9c42fbe-5c56-4a62-883b-05770f1b73cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:20.677132 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c9c42fbe-5c56-4a62-883b-05770f1b73cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:20.810082 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c9c42fbe-5c56-4a62-883b-05770f1b73cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:20.817746 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c9c42fbe-5c56-4a62-883b-05770f1b73cc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1682 microversion: 2.1 time: 0.155106 Sep 13 03:28:20.818302 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 352/733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:20 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:21.227204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-290ea2ac-8ec5-4396-aa80-6be1d48b1d95 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:21.228025 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-290ea2ac-8ec5-4396-aa80-6be1d48b1d95 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:21.235083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-290ea2ac-8ec5-4396-aa80-6be1d48b1d95 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:21.235828 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-290ea2ac-8ec5-4396-aa80-6be1d48b1d95 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:21.236264 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-290ea2ac-8ec5-4396-aa80-6be1d48b1d95 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:21.236976 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-290ea2ac-8ec5-4396-aa80-6be1d48b1d95 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:21.237432 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-290ea2ac-8ec5-4396-aa80-6be1d48b1d95 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:21.237854 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-290ea2ac-8ec5-4396-aa80-6be1d48b1d95 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:21.533317 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-b7ecc6a0-4489-4702-a6c8-4d4495760a9a req-834b2c04-99c6-4c39-89d0-c1f2be51fc93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2620476c-6af0-419c-9d61-aeb1d1ee1457", "name": "network-vif-deleted", "tag": "c759dcee-1328-4e27-8f62-118adab12265"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:21.547134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-b7ecc6a0-4489-4702-a6c8-4d4495760a9a req-834b2c04-99c6-4c39-89d0-c1f2be51fc93 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:21.547628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-b7ecc6a0-4489-4702-a6c8-4d4495760a9a req-834b2c04-99c6-4c39-89d0-c1f2be51fc93 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:21.548147 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-b7ecc6a0-4489-4702-a6c8-4d4495760a9a req-834b2c04-99c6-4c39-89d0-c1f2be51fc93 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:21.548821 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-290ea2ac-8ec5-4396-aa80-6be1d48b1d95 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:21.557393 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-290ea2ac-8ec5-4396-aa80-6be1d48b1d95 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.334738 Sep 13 03:28:21.563495 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-b7ecc6a0-4489-4702-a6c8-4d4495760a9a req-834b2c04-99c6-4c39-89d0-c1f2be51fc93 service nova] Creating event network-vif-deleted:c759dcee-1328-4e27-8f62-118adab12265 for instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 on hv-cinder-85707 Sep 13 03:28:21.569403 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-b7ecc6a0-4489-4702-a6c8-4d4495760a9a req-834b2c04-99c6-4c39-89d0-c1f2be51fc93 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040495 Sep 13 03:28:21.570392 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 353/734] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:28:21.584923 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 382/735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:21 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:21.844080 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:21.844781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:21.851590 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:21.852355 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:21.852977 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:21.853894 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:21.854528 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:21.855210 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:21.890122 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:21.890780 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:21.891550 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:21.891739 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lazy-loading 'fault' on Instance uuid 2620476c-6af0-419c-9d61-aeb1d1ee1457 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:28:21.937952 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:21.947099 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-331ab03b-dc1f-4a55-9484-f5a829f11982 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 200 len: 1331 microversion: 2.1 time: 0.107286 Sep 13 03:28:21.947781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 354/736] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:21 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:22.587774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b12d8987-9e6e-4fd4-ab4f-de438eb33735 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:22.589290 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b12d8987-9e6e-4fd4-ab4f-de438eb33735 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:22.597458 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b12d8987-9e6e-4fd4-ab4f-de438eb33735 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:22.598961 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b12d8987-9e6e-4fd4-ab4f-de438eb33735 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:22.599615 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b12d8987-9e6e-4fd4-ab4f-de438eb33735 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:22.600777 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b12d8987-9e6e-4fd4-ab4f-de438eb33735 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:22.601429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b12d8987-9e6e-4fd4-ab4f-de438eb33735 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:22.602103 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b12d8987-9e6e-4fd4-ab4f-de438eb33735 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:22.831516 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b12d8987-9e6e-4fd4-ab4f-de438eb33735 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:22.839881 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b12d8987-9e6e-4fd4-ab4f-de438eb33735 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.259009 Sep 13 03:28:22.840458 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 383/737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:22 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:22.971454 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-cb073dc0-37b6-46a4-84e3-36f9a02f55f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:22.971993 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-cb073dc0-37b6-46a4-84e3-36f9a02f55f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:22.978889 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cb073dc0-37b6-46a4-84e3-36f9a02f55f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:22.979369 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cb073dc0-37b6-46a4-84e3-36f9a02f55f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:22.979824 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cb073dc0-37b6-46a4-84e3-36f9a02f55f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:22.980504 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cb073dc0-37b6-46a4-84e3-36f9a02f55f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:22.980947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cb073dc0-37b6-46a4-84e3-36f9a02f55f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:22.981397 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cb073dc0-37b6-46a4-84e3-36f9a02f55f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:22.994941 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-cb073dc0-37b6-46a4-84e3-36f9a02f55f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-cb073dc0-37b6-46a4-84e3-36f9a02f55f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 HTTP/1.1 Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:28:22.996541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:28:22.998144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:28:22.998144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:28:22.998144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:28:22.998144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:28:22.998144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:28:22.998144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:28:22.998144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:28:22.998144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:28:22.998144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:28:22.998144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:28:22.998144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:28:22.998144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': '2620476c-6af0-419c-9d61-aeb1d1ee1457'} Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:28:22.999518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:28:23.000849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:23.002712 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-cb073dc0-37b6-46a4-84e3-36f9a02f55f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 404 to user: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:28:23.002712 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-cb073dc0-37b6-46a4-84e3-36f9a02f55f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 404 len: 111 microversion: 2.1 time: 0.030405 Sep 13 03:28:23.002712 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 355/738] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:22 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:28:23.008002 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-268aef9d-f17b-4b92-8871-b998406dd500 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '.version_select at 0x7f8935818af0>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:23.028388 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-268aef9d-f17b-4b92-8871-b998406dd500 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014592158" status: 202 len: 0 microversion: 2.1 time: 0.024105 Sep 13 03:28:23.028969 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 384/739] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Sep 13 03:28:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014592158 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:28:23.689132 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-bb584811-4078-4d52-86b1-644301edd51f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:23.689621 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-bb584811-4078-4d52-86b1-644301edd51f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:23.695457 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bb584811-4078-4d52-86b1-644301edd51f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:23.695937 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bb584811-4078-4d52-86b1-644301edd51f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:23.696363 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bb584811-4078-4d52-86b1-644301edd51f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:23.697043 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bb584811-4078-4d52-86b1-644301edd51f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:23.697488 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bb584811-4078-4d52-86b1-644301edd51f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:23.697905 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bb584811-4078-4d52-86b1-644301edd51f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:23.781970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-bb584811-4078-4d52-86b1-644301edd51f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lazy-loading 'services' on Instance uuid dab865ad-8ee0-4def-a996-caa5e4e30f30 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:28:23.852476 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-bb584811-4078-4d52-86b1-644301edd51f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/os-volume_attachments/9d043ba5-31f8-4fac-8514-c63d892ce155" status: 202 len: 0 microversion: 2.1 time: 0.167021 Sep 13 03:28:23.853050 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 356/740] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 03:28:23 2022] DELETE /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/os-volume_attachments/9d043ba5-31f8-4fac-8514-c63d892ce155 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:28:23.861778 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-05f18307-d0a9-4afa-8a3b-155946551acb tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:23.865702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-05f18307-d0a9-4afa-8a3b-155946551acb tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:23.873726 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05f18307-d0a9-4afa-8a3b-155946551acb tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:23.874392 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05f18307-d0a9-4afa-8a3b-155946551acb tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:23.874962 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05f18307-d0a9-4afa-8a3b-155946551acb tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:23.876262 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05f18307-d0a9-4afa-8a3b-155946551acb tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:23.876723 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05f18307-d0a9-4afa-8a3b-155946551acb tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:23.877255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05f18307-d0a9-4afa-8a3b-155946551acb tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:23.911668 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-05f18307-d0a9-4afa-8a3b-155946551acb tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053061 Sep 13 03:28:23.917446 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 385/741] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:28:23 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:28:23.967294 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c2c0a661-efcc-447f-bfcd-3f1da72a6cda tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:23.968169 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c2c0a661-efcc-447f-bfcd-3f1da72a6cda tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:23.975730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2c0a661-efcc-447f-bfcd-3f1da72a6cda tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:23.976333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2c0a661-efcc-447f-bfcd-3f1da72a6cda tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:23.976650 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2c0a661-efcc-447f-bfcd-3f1da72a6cda tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:23.977352 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2c0a661-efcc-447f-bfcd-3f1da72a6cda tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:23.977810 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2c0a661-efcc-447f-bfcd-3f1da72a6cda tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:23.978233 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2c0a661-efcc-447f-bfcd-3f1da72a6cda tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:24.111911 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c2c0a661-efcc-447f-bfcd-3f1da72a6cda tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:24.119537 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c2c0a661-efcc-447f-bfcd-3f1da72a6cda tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.261404 Sep 13 03:28:24.120099 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 357/742] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:23 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:28:24.925521 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-064f00c1-024e-4ca9-a236-b09d062860a2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:24.928370 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-064f00c1-024e-4ca9-a236-b09d062860a2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:24.934488 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-064f00c1-024e-4ca9-a236-b09d062860a2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:24.935021 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-064f00c1-024e-4ca9-a236-b09d062860a2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:24.935455 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-064f00c1-024e-4ca9-a236-b09d062860a2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:24.936169 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-064f00c1-024e-4ca9-a236-b09d062860a2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:24.936619 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-064f00c1-024e-4ca9-a236-b09d062860a2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:24.937158 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-064f00c1-024e-4ca9-a236-b09d062860a2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:24.966438 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-064f00c1-024e-4ca9-a236-b09d062860a2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045388 Sep 13 03:28:24.967193 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 386/743] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:28:24 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:28:25.141278 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c96a97c5-d40e-49a7-aa74-f878923ce300 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:25.141889 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c96a97c5-d40e-49a7-aa74-f878923ce300 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:25.148292 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c96a97c5-d40e-49a7-aa74-f878923ce300 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:25.148784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c96a97c5-d40e-49a7-aa74-f878923ce300 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:25.149219 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c96a97c5-d40e-49a7-aa74-f878923ce300 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:25.149905 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c96a97c5-d40e-49a7-aa74-f878923ce300 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:25.150361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c96a97c5-d40e-49a7-aa74-f878923ce300 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:25.150818 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c96a97c5-d40e-49a7-aa74-f878923ce300 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:25.279499 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c96a97c5-d40e-49a7-aa74-f878923ce300 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:25.287795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c96a97c5-d40e-49a7-aa74-f878923ce300 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.150452 Sep 13 03:28:25.288362 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 358/744] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:25 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:25.979076 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1b521f2d-1e8d-432c-9497-2f3e40749541 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:25.981218 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1b521f2d-1e8d-432c-9497-2f3e40749541 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:25.987506 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1b521f2d-1e8d-432c-9497-2f3e40749541 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:25.987990 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1b521f2d-1e8d-432c-9497-2f3e40749541 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:25.988428 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1b521f2d-1e8d-432c-9497-2f3e40749541 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:25.989110 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1b521f2d-1e8d-432c-9497-2f3e40749541 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:25.989563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1b521f2d-1e8d-432c-9497-2f3e40749541 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:25.989987 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1b521f2d-1e8d-432c-9497-2f3e40749541 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:26.021060 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1b521f2d-1e8d-432c-9497-2f3e40749541 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046102 Sep 13 03:28:26.021612 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 387/745] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:28:25 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 03:28:26.084794 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c738a390-2acc-4ebc-a231-c3f755637652 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:26.085299 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c738a390-2acc-4ebc-a231-c3f755637652 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:26.091155 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c738a390-2acc-4ebc-a231-c3f755637652 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:26.091644 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c738a390-2acc-4ebc-a231-c3f755637652 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:26.092148 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c738a390-2acc-4ebc-a231-c3f755637652 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:26.092842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c738a390-2acc-4ebc-a231-c3f755637652 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:26.093296 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c738a390-2acc-4ebc-a231-c3f755637652 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:26.093721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c738a390-2acc-4ebc-a231-c3f755637652 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:26.120788 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c738a390-2acc-4ebc-a231-c3f755637652 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:28:26.198720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c738a390-2acc-4ebc-a231-c3f755637652 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 204 len: 0 microversion: 2.1 time: 0.118572 Sep 13 03:28:26.199532 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 359/746] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:28:26 2022] DELETE /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 03:28:26.208596 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-fc46ab31-32d5-40b4-9828-f76503b6c2ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:26.209208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-fc46ab31-32d5-40b4-9828-f76503b6c2ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:26.214932 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fc46ab31-32d5-40b4-9828-f76503b6c2ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:26.215411 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fc46ab31-32d5-40b4-9828-f76503b6c2ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:26.215840 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fc46ab31-32d5-40b4-9828-f76503b6c2ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:26.216545 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fc46ab31-32d5-40b4-9828-f76503b6c2ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:26.216993 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fc46ab31-32d5-40b4-9828-f76503b6c2ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:26.217407 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fc46ab31-32d5-40b4-9828-f76503b6c2ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:26.221511 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:26.312139 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1e6d17b3-2f57-45e5-ae33-bb5c7045abc0 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:26.312842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-1e6d17b3-2f57-45e5-ae33-bb5c7045abc0 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:26.319313 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1e6d17b3-2f57-45e5-ae33-bb5c7045abc0 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:26.319797 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1e6d17b3-2f57-45e5-ae33-bb5c7045abc0 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:26.320231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1e6d17b3-2f57-45e5-ae33-bb5c7045abc0 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:26.320921 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1e6d17b3-2f57-45e5-ae33-bb5c7045abc0 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:26.321376 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1e6d17b3-2f57-45e5-ae33-bb5c7045abc0 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:26.321801 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1e6d17b3-2f57-45e5-ae33-bb5c7045abc0 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:26.325935 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:26.351550 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-fc46ab31-32d5-40b4-9828-f76503b6c2ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:26.359291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-fc46ab31-32d5-40b4-9828-f76503b6c2ea tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1681 microversion: 2.1 time: 0.155036 Sep 13 03:28:26.359852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 388/747] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:26 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:26.459433 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-1e6d17b3-2f57-45e5-ae33-bb5c7045abc0 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:26.467619 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1e6d17b3-2f57-45e5-ae33-bb5c7045abc0 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.159660 Sep 13 03:28:26.468186 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 360/748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:26 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:28:27.383538 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-705f6aae-64e3-4909-b47d-347c0a3cba3e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:27.384074 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-705f6aae-64e3-4909-b47d-347c0a3cba3e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:27.390318 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-705f6aae-64e3-4909-b47d-347c0a3cba3e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:27.390831 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-705f6aae-64e3-4909-b47d-347c0a3cba3e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:27.391265 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-705f6aae-64e3-4909-b47d-347c0a3cba3e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:27.391940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-705f6aae-64e3-4909-b47d-347c0a3cba3e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:27.392390 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-705f6aae-64e3-4909-b47d-347c0a3cba3e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:27.392805 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-705f6aae-64e3-4909-b47d-347c0a3cba3e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:27.491031 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9841be3c-cf8f-4184-9ae0-ce3b4d6bebe5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:27.491634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9841be3c-cf8f-4184-9ae0-ce3b4d6bebe5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:27.498152 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9841be3c-cf8f-4184-9ae0-ce3b4d6bebe5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:27.498673 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9841be3c-cf8f-4184-9ae0-ce3b4d6bebe5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:27.499111 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9841be3c-cf8f-4184-9ae0-ce3b4d6bebe5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:27.499839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9841be3c-cf8f-4184-9ae0-ce3b4d6bebe5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:27.500309 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9841be3c-cf8f-4184-9ae0-ce3b4d6bebe5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:27.500733 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9841be3c-cf8f-4184-9ae0-ce3b4d6bebe5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:27.519642 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-705f6aae-64e3-4909-b47d-347c0a3cba3e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:27.527169 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-705f6aae-64e3-4909-b47d-347c0a3cba3e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1681 microversion: 2.1 time: 0.148077 Sep 13 03:28:27.527734 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 389/749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:27 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:27.628595 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9841be3c-cf8f-4184-9ae0-ce3b4d6bebe5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:27.636380 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9841be3c-cf8f-4184-9ae0-ce3b4d6bebe5 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.149659 Sep 13 03:28:27.637061 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 361/750] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:27 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:28:28.551295 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-dc9aefc8-308f-45e8-823a-cc9c49bcdc2a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:28.551893 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-dc9aefc8-308f-45e8-823a-cc9c49bcdc2a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:28.558481 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dc9aefc8-308f-45e8-823a-cc9c49bcdc2a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:28.559100 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dc9aefc8-308f-45e8-823a-cc9c49bcdc2a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:28.559574 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dc9aefc8-308f-45e8-823a-cc9c49bcdc2a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:28.560263 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dc9aefc8-308f-45e8-823a-cc9c49bcdc2a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:28.560741 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dc9aefc8-308f-45e8-823a-cc9c49bcdc2a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:28.561190 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dc9aefc8-308f-45e8-823a-cc9c49bcdc2a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:28.659842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-29a76af5-680a-4919-af9d-4a70cdd25e73 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:28.661058 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-29a76af5-680a-4919-af9d-4a70cdd25e73 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:28.668345 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-29a76af5-680a-4919-af9d-4a70cdd25e73 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:28.668345 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-29a76af5-680a-4919-af9d-4a70cdd25e73 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:28.668658 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-29a76af5-680a-4919-af9d-4a70cdd25e73 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:28.669363 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-29a76af5-680a-4919-af9d-4a70cdd25e73 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:28.669817 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-29a76af5-680a-4919-af9d-4a70cdd25e73 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:28.670243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-29a76af5-680a-4919-af9d-4a70cdd25e73 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:28.783259 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-dc9aefc8-308f-45e8-823a-cc9c49bcdc2a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:28.792663 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-dc9aefc8-308f-45e8-823a-cc9c49bcdc2a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1681 microversion: 2.1 time: 0.245187 Sep 13 03:28:28.800007 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-29a76af5-680a-4919-af9d-4a70cdd25e73 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:28.807204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 390/751] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:28 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:28.808800 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-29a76af5-680a-4919-af9d-4a70cdd25e73 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.153973 Sep 13 03:28:28.809363 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 362/752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:28 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:28:29.460281 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-2255f368-8f95-49b3-98d8-4a1c6cd55f57 req-4587bab8-55f1-4414-81bc-91da929545d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab865ad-8ee0-4def-a996-caa5e4e30f30", "name": "network-vif-deleted", "tag": "99e3ee84-e44d-466c-bb25-da0a34a04a5e"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:29.470775 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2255f368-8f95-49b3-98d8-4a1c6cd55f57 req-4587bab8-55f1-4414-81bc-91da929545d7 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:29.471354 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2255f368-8f95-49b3-98d8-4a1c6cd55f57 req-4587bab8-55f1-4414-81bc-91da929545d7 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:29.472025 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2255f368-8f95-49b3-98d8-4a1c6cd55f57 req-4587bab8-55f1-4414-81bc-91da929545d7 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:29.484197 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-2255f368-8f95-49b3-98d8-4a1c6cd55f57 req-4587bab8-55f1-4414-81bc-91da929545d7 service nova] Creating event network-vif-deleted:99e3ee84-e44d-466c-bb25-da0a34a04a5e for instance dab865ad-8ee0-4def-a996-caa5e4e30f30 on hv-cinder-85707 Sep 13 03:28:29.489876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-2255f368-8f95-49b3-98d8-4a1c6cd55f57 req-4587bab8-55f1-4414-81bc-91da929545d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033397 Sep 13 03:28:29.490828 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 391/753] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:28:29.816276 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:29.817498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:29.823825 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:29.824305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:29.824735 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:29.825451 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:29.825897 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:29.826315 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:29.833205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-da8c75a8-04c5-4746-aba0-be3f50a8c0c9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:29.834567 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-da8c75a8-04c5-4746-aba0-be3f50a8c0c9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:29.840888 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-da8c75a8-04c5-4746-aba0-be3f50a8c0c9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:29.841372 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-da8c75a8-04c5-4746-aba0-be3f50a8c0c9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:29.841803 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-da8c75a8-04c5-4746-aba0-be3f50a8c0c9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:29.842501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-da8c75a8-04c5-4746-aba0-be3f50a8c0c9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:29.842977 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-da8c75a8-04c5-4746-aba0-be3f50a8c0c9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:29.843397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-da8c75a8-04c5-4746-aba0-be3f50a8c0c9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:29.858551 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:29.859001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:29.859427 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:29.859869 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lazy-loading 'fault' on Instance uuid dab865ad-8ee0-4def-a996-caa5e4e30f30 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:28:29.903693 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:29.911319 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-22b1ffce-1750-4b1a-96b7-128dba8ddf70 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 200 len: 1331 microversion: 2.1 time: 0.098848 Sep 13 03:28:29.911886 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 363/754] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:29 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:29.982351 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-da8c75a8-04c5-4746-aba0-be3f50a8c0c9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:29.990770 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-da8c75a8-04c5-4746-aba0-be3f50a8c0c9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1569 microversion: 2.1 time: 0.162867 Sep 13 03:28:29.991359 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 392/755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:29 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:28:30.013034 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-47edfe28-c6aa-4255-96ad-d6b619aef923 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:30.013633 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-47edfe28-c6aa-4255-96ad-d6b619aef923 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:30.019468 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47edfe28-c6aa-4255-96ad-d6b619aef923 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:30.019930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47edfe28-c6aa-4255-96ad-d6b619aef923 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:30.020362 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47edfe28-c6aa-4255-96ad-d6b619aef923 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:30.021047 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47edfe28-c6aa-4255-96ad-d6b619aef923 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:30.021505 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47edfe28-c6aa-4255-96ad-d6b619aef923 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:30.021927 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-47edfe28-c6aa-4255-96ad-d6b619aef923 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:30.051640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-47edfe28-c6aa-4255-96ad-d6b619aef923 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120384) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 03:28:30.139600 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-47edfe28-c6aa-4255-96ad-d6b619aef923 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "POST /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6/action" status: 202 len: 0 microversion: 2.1 time: 0.129716 Sep 13 03:28:30.140788 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 364/756] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:28:30 2022] POST /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:28:30.155829 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2dc24942-91c4-451d-ba3e-5e111d2adf03 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:30.158149 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2dc24942-91c4-451d-ba3e-5e111d2adf03 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:30.172381 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2dc24942-91c4-451d-ba3e-5e111d2adf03 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:30.173814 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2dc24942-91c4-451d-ba3e-5e111d2adf03 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:30.175180 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2dc24942-91c4-451d-ba3e-5e111d2adf03 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:30.176756 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2dc24942-91c4-451d-ba3e-5e111d2adf03 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:30.177286 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2dc24942-91c4-451d-ba3e-5e111d2adf03 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:30.180734 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2dc24942-91c4-451d-ba3e-5e111d2adf03 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:30.360117 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2dc24942-91c4-451d-ba3e-5e111d2adf03 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:30.368390 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2dc24942-91c4-451d-ba3e-5e111d2adf03 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1517 microversion: 2.1 time: 0.223530 Sep 13 03:28:30.378665 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 393/757] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:30 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1517 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:30.935090 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-17f40d37-c34e-4b7a-b8ad-a9150005b074 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:30.935826 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-17f40d37-c34e-4b7a-b8ad-a9150005b074 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:30.941767 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17f40d37-c34e-4b7a-b8ad-a9150005b074 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:30.942252 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17f40d37-c34e-4b7a-b8ad-a9150005b074 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:30.942717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17f40d37-c34e-4b7a-b8ad-a9150005b074 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:30.943405 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17f40d37-c34e-4b7a-b8ad-a9150005b074 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:30.943913 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17f40d37-c34e-4b7a-b8ad-a9150005b074 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:30.944272 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17f40d37-c34e-4b7a-b8ad-a9150005b074 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:30.960386 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-17f40d37-c34e-4b7a-b8ad-a9150005b074 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-17f40d37-c34e-4b7a-b8ad-a9150005b074 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 HTTP/1.1 Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:28:30.962074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:28:30.963849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:28:30.963849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:28:30.963849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:28:30.963849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:28:30.963849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:28:30.963849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:28:30.963849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:28:30.963849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:28:30.963849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:28:30.963849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:28:30.963849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:28:30.963849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': 'dab865ad-8ee0-4def-a996-caa5e4e30f30'} Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:28:30.964962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:28:30.966779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:28:30.968408 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-17f40d37-c34e-4b7a-b8ad-a9150005b074 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 404 to user: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:28:30.968408 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-17f40d37-c34e-4b7a-b8ad-a9150005b074 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 404 len: 111 microversion: 2.1 time: 0.033057 Sep 13 03:28:30.968408 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 365/758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:30 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 03:28:30.972591 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a8bfbc9d-2686-46ab-abcb-a2feb6f85c0c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '.version_select at 0x7f8935715550>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:30.991655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a8bfbc9d-2686-46ab-abcb-a2feb6f85c0c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-901273638" status: 202 len: 0 microversion: 2.1 time: 0.023208 Sep 13 03:28:30.992235 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 394/759] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Sep 13 03:28:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-901273638 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:28:31.393529 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-dec8a48e-7c21-4843-8680-93cdf0576dd8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:31.394049 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-dec8a48e-7c21-4843-8680-93cdf0576dd8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:31.400228 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dec8a48e-7c21-4843-8680-93cdf0576dd8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:31.400714 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dec8a48e-7c21-4843-8680-93cdf0576dd8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:31.401147 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dec8a48e-7c21-4843-8680-93cdf0576dd8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:31.401844 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dec8a48e-7c21-4843-8680-93cdf0576dd8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:31.402295 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dec8a48e-7c21-4843-8680-93cdf0576dd8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:31.402735 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dec8a48e-7c21-4843-8680-93cdf0576dd8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:31.606705 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-745c89e7-d389-4a01-b49e-b4af3a822e21 req-7def606f-12e7-4768-bac4-41c57ed88a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae88f2e-fe4e-46c6-bf5a-0381e90e26c6", "name": "network-vif-unplugged", "status": "completed", "tag": "802c0f2a-3726-4731-b295-4046e1e4707e"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:31.621710 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-745c89e7-d389-4a01-b49e-b4af3a822e21 req-7def606f-12e7-4768-bac4-41c57ed88a41 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:31.622263 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-745c89e7-d389-4a01-b49e-b4af3a822e21 req-7def606f-12e7-4768-bac4-41c57ed88a41 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:31.622722 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-745c89e7-d389-4a01-b49e-b4af3a822e21 req-7def606f-12e7-4768-bac4-41c57ed88a41 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:31.636084 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.compute.server_external_events [req-745c89e7-d389-4a01-b49e-b4af3a822e21 req-7def606f-12e7-4768-bac4-41c57ed88a41 service nova] Unable to find a host for instance aae88f2e-fe4e-46c6-bf5a-0381e90e26c6. Dropping event network-vif-unplugged {{(pid=120383) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 03:28:31.637233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-745c89e7-d389-4a01-b49e-b4af3a822e21 req-7def606f-12e7-4768-bac4-41c57ed88a41 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034642 Sep 13 03:28:31.638034 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 395/760] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 13 03:28:31.765792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-dec8a48e-7c21-4843-8680-93cdf0576dd8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:31.773979 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-dec8a48e-7c21-4843-8680-93cdf0576dd8 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1519 microversion: 2.1 time: 0.384421 Sep 13 03:28:31.774545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 366/761] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:31 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1519 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:31.936011 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-373ec610-7f6b-4ce6-8976-057a57936e9e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'create', calling method: .version_select at 0x7f893576a280>, body: {"keypair": {"name": "tempest-keypair-1454670344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9WNwXWFtjhmrLmi+ZKJAxDKB1T7hqu3MYch026Y3E6W8+7nn/89LWiIJ21QLSS5pPlFVMQPidhw0Dngif1G1tnDvqtiguPzOjygouDo0kipqKl+GMTHgNxcHFmcqmx3g=="}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:31.952224 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-373ec610-7f6b-4ce6-8976-057a57936e9e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'key_pairs'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:28:31.956025 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-373ec610-7f6b-4ce6-8976-057a57936e9e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for user 4f76a7c6fe9347b0bea5f701bccb6150 and project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'key_pairs'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:28:31.978996 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-373ec610-7f6b-4ce6-8976-057a57936e9e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047252 Sep 13 03:28:31.979577 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 396/762] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 03:28:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:28:32.797634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ddac4049-e6f9-4ae1-bf37-323193bf41a4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:32.798500 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ddac4049-e6f9-4ae1-bf37-323193bf41a4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:32.818474 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ddac4049-e6f9-4ae1-bf37-323193bf41a4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:32.820438 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ddac4049-e6f9-4ae1-bf37-323193bf41a4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:32.821001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ddac4049-e6f9-4ae1-bf37-323193bf41a4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:32.821844 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ddac4049-e6f9-4ae1-bf37-323193bf41a4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:32.822415 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ddac4049-e6f9-4ae1-bf37-323193bf41a4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:32.823115 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ddac4049-e6f9-4ae1-bf37-323193bf41a4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:33.032703 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ddac4049-e6f9-4ae1-bf37-323193bf41a4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:33.040995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ddac4049-e6f9-4ae1-bf37-323193bf41a4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.247753 Sep 13 03:28:33.041577 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 367/763] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:32 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:33.347099 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-347622909", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36a6ffba-7b10-4536-9b6f-36478b4a6ccb"}], "security_groups": [{"name": "tempest-securitygroup--2019084500"}], "key_name": "tempest-keypair-1454670344", "user_data": "}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:33.449309 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.network.neutron [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] validate_networks() for [('36a6ffba-7b10-4536-9b6f-36478b4a6ccb', None, None, None, None, None)] {{(pid=120383) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:28:33.854448 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Flavor limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:28:33.854906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Image limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:28:33.855385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Flavor pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:28:33.855795 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Image pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:28:33.856222 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:28:33.864985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:33.865468 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:33.865905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:33.866657 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:33.867116 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:33.867543 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:33.883686 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:28:33.887603 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for user 4f76a7c6fe9347b0bea5f701bccb6150 and project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:28:33.898758 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Going to run 1 instances... {{(pid=120383) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:28:33.901013 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:28:33.947794 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-cb21812d-173d-4f98-8c32-8ea393d95c56 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.604952 Sep 13 03:28:33.954525 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 397/764] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:28:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:28:33.961792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2b025499-12bf-4f2b-99ee-2292b146bbf8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:33.962536 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2b025499-12bf-4f2b-99ee-2292b146bbf8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:34.017201 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2b025499-12bf-4f2b-99ee-2292b146bbf8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:34.024705 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2b025499-12bf-4f2b-99ee-2292b146bbf8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1241 microversion: 2.1 time: 0.068634 Sep 13 03:28:34.025274 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 368/765] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:33 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:34.065510 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d78adb61-dadd-4e0c-b428-c4c328a865b2 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:34.066200 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d78adb61-dadd-4e0c-b428-c4c328a865b2 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:34.074118 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d78adb61-dadd-4e0c-b428-c4c328a865b2 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:34.074738 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d78adb61-dadd-4e0c-b428-c4c328a865b2 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:34.075169 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d78adb61-dadd-4e0c-b428-c4c328a865b2 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:34.075758 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d78adb61-dadd-4e0c-b428-c4c328a865b2 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:34.076211 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d78adb61-dadd-4e0c-b428-c4c328a865b2 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:34.076633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d78adb61-dadd-4e0c-b428-c4c328a865b2 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:34.214100 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d78adb61-dadd-4e0c-b428-c4c328a865b2 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:34.222684 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d78adb61-dadd-4e0c-b428-c4c328a865b2 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.161027 Sep 13 03:28:34.223359 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 398/766] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:34 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:35.047175 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-81698712-df86-4ee9-a5de-a8a1f088cc53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:35.047809 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-81698712-df86-4ee9-a5de-a8a1f088cc53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:35.055282 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81698712-df86-4ee9-a5de-a8a1f088cc53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:35.055761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81698712-df86-4ee9-a5de-a8a1f088cc53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:35.056191 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81698712-df86-4ee9-a5de-a8a1f088cc53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:35.056870 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81698712-df86-4ee9-a5de-a8a1f088cc53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:35.057322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81698712-df86-4ee9-a5de-a8a1f088cc53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:35.057740 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-81698712-df86-4ee9-a5de-a8a1f088cc53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:35.121547 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-81698712-df86-4ee9-a5de-a8a1f088cc53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:35.129074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-81698712-df86-4ee9-a5de-a8a1f088cc53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1293 microversion: 2.1 time: 0.085674 Sep 13 03:28:35.129633 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 369/767] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:35 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:35.246557 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-47b8e70e-b24e-4086-aece-18fde7d3e44d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:35.247321 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-47b8e70e-b24e-4086-aece-18fde7d3e44d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:35.253708 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-47b8e70e-b24e-4086-aece-18fde7d3e44d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:35.254195 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-47b8e70e-b24e-4086-aece-18fde7d3e44d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:35.254680 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-47b8e70e-b24e-4086-aece-18fde7d3e44d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:35.255365 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-47b8e70e-b24e-4086-aece-18fde7d3e44d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:35.255819 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-47b8e70e-b24e-4086-aece-18fde7d3e44d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:35.256240 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-47b8e70e-b24e-4086-aece-18fde7d3e44d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:35.478410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-47b8e70e-b24e-4086-aece-18fde7d3e44d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:35.486468 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-47b8e70e-b24e-4086-aece-18fde7d3e44d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.243704 Sep 13 03:28:35.487124 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 399/768] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:35 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:28:36.152049 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0c4fa9a4-1360-4785-913e-c9b85eb229ba tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:36.152662 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0c4fa9a4-1360-4785-913e-c9b85eb229ba tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:36.159018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c4fa9a4-1360-4785-913e-c9b85eb229ba tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:36.159644 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c4fa9a4-1360-4785-913e-c9b85eb229ba tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:36.160701 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c4fa9a4-1360-4785-913e-c9b85eb229ba tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:36.161399 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c4fa9a4-1360-4785-913e-c9b85eb229ba tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:36.161856 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c4fa9a4-1360-4785-913e-c9b85eb229ba tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:36.162279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0c4fa9a4-1360-4785-913e-c9b85eb229ba tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:36.308836 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0c4fa9a4-1360-4785-913e-c9b85eb229ba tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:36.317210 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0c4fa9a4-1360-4785-913e-c9b85eb229ba tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1367 microversion: 2.1 time: 0.168942 Sep 13 03:28:36.317873 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 370/769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:36 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:36.509741 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a0b42936-9c1f-4ea2-b6e8-1a77acaecfbe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:36.510385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a0b42936-9c1f-4ea2-b6e8-1a77acaecfbe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:36.516715 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0b42936-9c1f-4ea2-b6e8-1a77acaecfbe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:36.517201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0b42936-9c1f-4ea2-b6e8-1a77acaecfbe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:36.517639 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0b42936-9c1f-4ea2-b6e8-1a77acaecfbe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:36.518330 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0b42936-9c1f-4ea2-b6e8-1a77acaecfbe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:36.518821 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0b42936-9c1f-4ea2-b6e8-1a77acaecfbe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:36.519250 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a0b42936-9c1f-4ea2-b6e8-1a77acaecfbe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:36.737274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a0b42936-9c1f-4ea2-b6e8-1a77acaecfbe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:36.746463 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a0b42936-9c1f-4ea2-b6e8-1a77acaecfbe tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.240461 Sep 13 03:28:36.747076 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 400/770] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:36 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:36.987414 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-bae78b76-3fc9-4007-bd85-e94cc14c27f8 req-5d1fc4be-3dd1-46c2-8411-ae66b952cc61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0446c67-3992-4af8-9863-0eed6088d0a7", "tag": "bd04d4b1-89e1-4671-a828-65eb8d1e5eab"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:36.999220 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-bae78b76-3fc9-4007-bd85-e94cc14c27f8 req-5d1fc4be-3dd1-46c2-8411-ae66b952cc61 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:36.999716 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-bae78b76-3fc9-4007-bd85-e94cc14c27f8 req-5d1fc4be-3dd1-46c2-8411-ae66b952cc61 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:37.000150 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-bae78b76-3fc9-4007-bd85-e94cc14c27f8 req-5d1fc4be-3dd1-46c2-8411-ae66b952cc61 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:37.011679 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-bae78b76-3fc9-4007-bd85-e94cc14c27f8 req-5d1fc4be-3dd1-46c2-8411-ae66b952cc61 service nova] Creating event network-changed:bd04d4b1-89e1-4671-a828-65eb8d1e5eab for instance d0446c67-3992-4af8-9863-0eed6088d0a7 on hv-cinder-85707 Sep 13 03:28:37.016468 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-bae78b76-3fc9-4007-bd85-e94cc14c27f8 req-5d1fc4be-3dd1-46c2-8411-ae66b952cc61 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032935 Sep 13 03:28:37.017148 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 371/771] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:28:37.340822 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8dbcff3c-83c6-4c5b-97d7-fb893520d4b2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:37.341436 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8dbcff3c-83c6-4c5b-97d7-fb893520d4b2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:37.347307 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8dbcff3c-83c6-4c5b-97d7-fb893520d4b2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:37.348289 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8dbcff3c-83c6-4c5b-97d7-fb893520d4b2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:37.348728 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8dbcff3c-83c6-4c5b-97d7-fb893520d4b2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:37.349429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8dbcff3c-83c6-4c5b-97d7-fb893520d4b2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:37.349882 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8dbcff3c-83c6-4c5b-97d7-fb893520d4b2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:37.350305 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8dbcff3c-83c6-4c5b-97d7-fb893520d4b2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:37.508571 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-8dbcff3c-83c6-4c5b-97d7-fb893520d4b2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:37.516743 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8dbcff3c-83c6-4c5b-97d7-fb893520d4b2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1367 microversion: 2.1 time: 0.179826 Sep 13 03:28:37.517336 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 401/772] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:37 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:37.771318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-18449f1c-83fe-4c2a-be2d-5e5f59c20edb tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:37.771935 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-18449f1c-83fe-4c2a-be2d-5e5f59c20edb tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:37.778043 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-18449f1c-83fe-4c2a-be2d-5e5f59c20edb tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:37.778529 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-18449f1c-83fe-4c2a-be2d-5e5f59c20edb tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:37.778990 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-18449f1c-83fe-4c2a-be2d-5e5f59c20edb tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:37.779689 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-18449f1c-83fe-4c2a-be2d-5e5f59c20edb tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:37.780146 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-18449f1c-83fe-4c2a-be2d-5e5f59c20edb tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:37.780566 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-18449f1c-83fe-4c2a-be2d-5e5f59c20edb tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:37.909002 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-18449f1c-83fe-4c2a-be2d-5e5f59c20edb tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:37.916818 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-18449f1c-83fe-4c2a-be2d-5e5f59c20edb tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.150892 Sep 13 03:28:37.917406 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 372/773] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:37 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:38.106432 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d9f5707d-6ccc-4914-863f-0c58670b2b48 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:38.106963 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d9f5707d-6ccc-4914-863f-0c58670b2b48 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:38.112805 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9f5707d-6ccc-4914-863f-0c58670b2b48 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:38.113284 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9f5707d-6ccc-4914-863f-0c58670b2b48 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:38.113714 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9f5707d-6ccc-4914-863f-0c58670b2b48 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:38.114396 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9f5707d-6ccc-4914-863f-0c58670b2b48 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:38.114868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9f5707d-6ccc-4914-863f-0c58670b2b48 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:38.115288 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d9f5707d-6ccc-4914-863f-0c58670b2b48 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:38.147482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d9f5707d-6ccc-4914-863f-0c58670b2b48 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments/a0ec7061-20f5-4673-accb-4045a1c9ab67" status: 200 len: 194 microversion: 2.20 time: 0.044789 Sep 13 03:28:38.148310 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 402/774] 10.222.0.18 () {60 vars in 1454 bytes} [Tue Sep 13 03:28:38 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments/a0ec7061-20f5-4673-accb-4045a1c9ab67 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:28:38.215332 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c58bf3af-1aad-4a93-a418-1d6fb4920c56 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:38.215826 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c58bf3af-1aad-4a93-a418-1d6fb4920c56 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:38.221617 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c58bf3af-1aad-4a93-a418-1d6fb4920c56 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:38.222101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c58bf3af-1aad-4a93-a418-1d6fb4920c56 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:38.222535 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c58bf3af-1aad-4a93-a418-1d6fb4920c56 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:38.223247 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c58bf3af-1aad-4a93-a418-1d6fb4920c56 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:38.223699 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c58bf3af-1aad-4a93-a418-1d6fb4920c56 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:38.224121 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c58bf3af-1aad-4a93-a418-1d6fb4920c56 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:38.302402 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-c58bf3af-1aad-4a93-a418-1d6fb4920c56 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lazy-loading 'services' on Instance uuid a97f011a-6370-474e-9a62-e9229eb7d7ee {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:28:38.373444 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c58bf3af-1aad-4a93-a418-1d6fb4920c56 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments/a0ec7061-20f5-4673-accb-4045a1c9ab67" status: 202 len: 0 microversion: 2.20 time: 0.161944 Sep 13 03:28:38.374197 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 373/775] 10.222.0.18 () {60 vars in 1457 bytes} [Tue Sep 13 03:28:38 2022] DELETE /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments/a0ec7061-20f5-4673-accb-4045a1c9ab67 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:28:38.383140 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-80d98353-43b7-46e9-8b56-4d12051f37e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:38.385369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-80d98353-43b7-46e9-8b56-4d12051f37e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:38.391217 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-80d98353-43b7-46e9-8b56-4d12051f37e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:38.391699 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-80d98353-43b7-46e9-8b56-4d12051f37e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:38.392131 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-80d98353-43b7-46e9-8b56-4d12051f37e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:38.392811 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-80d98353-43b7-46e9-8b56-4d12051f37e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:38.393262 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-80d98353-43b7-46e9-8b56-4d12051f37e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:38.393684 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-80d98353-43b7-46e9-8b56-4d12051f37e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:38.422011 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-80d98353-43b7-46e9-8b56-4d12051f37e8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043647 Sep 13 03:28:38.422551 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 403/776] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 13 03:28:38 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:28:38.540472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-853952a1-a1ab-4855-b6aa-bdeaac00fce7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:38.541168 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-853952a1-a1ab-4855-b6aa-bdeaac00fce7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:38.547337 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-853952a1-a1ab-4855-b6aa-bdeaac00fce7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:38.547829 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-853952a1-a1ab-4855-b6aa-bdeaac00fce7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:38.548267 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-853952a1-a1ab-4855-b6aa-bdeaac00fce7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:38.548956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-853952a1-a1ab-4855-b6aa-bdeaac00fce7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:38.549401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-853952a1-a1ab-4855-b6aa-bdeaac00fce7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:38.549822 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-853952a1-a1ab-4855-b6aa-bdeaac00fce7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:38.679896 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-853952a1-a1ab-4855-b6aa-bdeaac00fce7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:38.687389 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-853952a1-a1ab-4855-b6aa-bdeaac00fce7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1367 microversion: 2.1 time: 0.151410 Sep 13 03:28:38.687950 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 374/777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:38 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:38.939476 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-bccc74ca-ae54-4f96-a462-057c8f8ada18 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:38.940088 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-bccc74ca-ae54-4f96-a462-057c8f8ada18 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:38.946886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bccc74ca-ae54-4f96-a462-057c8f8ada18 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:38.947373 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bccc74ca-ae54-4f96-a462-057c8f8ada18 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:38.947803 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bccc74ca-ae54-4f96-a462-057c8f8ada18 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:38.948479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bccc74ca-ae54-4f96-a462-057c8f8ada18 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:38.948928 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bccc74ca-ae54-4f96-a462-057c8f8ada18 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:38.949346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bccc74ca-ae54-4f96-a462-057c8f8ada18 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:39.076845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-bccc74ca-ae54-4f96-a462-057c8f8ada18 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:39.085569 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-bccc74ca-ae54-4f96-a462-057c8f8ada18 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.149865 Sep 13 03:28:39.086127 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 404/778] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:38 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:39.435312 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-057447c8-e45d-4dec-8801-adb892be52df tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:39.437556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-057447c8-e45d-4dec-8801-adb892be52df tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:39.443909 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-057447c8-e45d-4dec-8801-adb892be52df tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:39.444387 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-057447c8-e45d-4dec-8801-adb892be52df tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:39.444818 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-057447c8-e45d-4dec-8801-adb892be52df tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:39.445497 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-057447c8-e45d-4dec-8801-adb892be52df tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:39.445942 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-057447c8-e45d-4dec-8801-adb892be52df tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:39.446356 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-057447c8-e45d-4dec-8801-adb892be52df tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:39.475099 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-057447c8-e45d-4dec-8801-adb892be52df tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043720 Sep 13 03:28:39.475643 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 375/779] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 13 03:28:39 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:28:39.710188 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1aa17a5f-67d7-416b-b827-8527c6abb421 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:39.710760 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1aa17a5f-67d7-416b-b827-8527c6abb421 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:39.713734 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:39.717692 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1aa17a5f-67d7-416b-b827-8527c6abb421 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:39.718172 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1aa17a5f-67d7-416b-b827-8527c6abb421 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:39.718625 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1aa17a5f-67d7-416b-b827-8527c6abb421 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:39.719320 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1aa17a5f-67d7-416b-b827-8527c6abb421 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:39.719773 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1aa17a5f-67d7-416b-b827-8527c6abb421 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:39.720199 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1aa17a5f-67d7-416b-b827-8527c6abb421 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:39.849198 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1aa17a5f-67d7-416b-b827-8527c6abb421 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:39.856745 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1aa17a5f-67d7-416b-b827-8527c6abb421 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1367 microversion: 2.1 time: 0.150993 Sep 13 03:28:39.857305 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 405/780] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:39 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:40.108424 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9e01cd4b-de2c-4fe0-adcd-6829a2ec2594 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:40.109033 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9e01cd4b-de2c-4fe0-adcd-6829a2ec2594 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:40.115137 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9e01cd4b-de2c-4fe0-adcd-6829a2ec2594 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:40.115611 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9e01cd4b-de2c-4fe0-adcd-6829a2ec2594 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:40.116038 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9e01cd4b-de2c-4fe0-adcd-6829a2ec2594 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:40.116713 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9e01cd4b-de2c-4fe0-adcd-6829a2ec2594 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:40.117161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9e01cd4b-de2c-4fe0-adcd-6829a2ec2594 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:40.117578 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9e01cd4b-de2c-4fe0-adcd-6829a2ec2594 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:40.259989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9e01cd4b-de2c-4fe0-adcd-6829a2ec2594 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:40.268366 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9e01cd4b-de2c-4fe0-adcd-6829a2ec2594 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.163720 Sep 13 03:28:40.268949 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 376/781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:40 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:40.486966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-09021fdb-b6a5-4de3-852f-7540b610fd1d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:40.489650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-09021fdb-b6a5-4de3-852f-7540b610fd1d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:40.496014 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-09021fdb-b6a5-4de3-852f-7540b610fd1d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:40.496503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-09021fdb-b6a5-4de3-852f-7540b610fd1d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:40.496938 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-09021fdb-b6a5-4de3-852f-7540b610fd1d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:40.497632 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-09021fdb-b6a5-4de3-852f-7540b610fd1d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:40.498116 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-09021fdb-b6a5-4de3-852f-7540b610fd1d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:40.498544 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-09021fdb-b6a5-4de3-852f-7540b610fd1d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:40.527577 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-09021fdb-b6a5-4de3-852f-7540b610fd1d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044421 Sep 13 03:28:40.528557 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 406/782] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 13 03:28:40 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:28:40.880216 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d6aecb48-87d8-443b-9c25-c2b3cef304e0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:40.880860 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d6aecb48-87d8-443b-9c25-c2b3cef304e0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:40.883428 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:40.888628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6aecb48-87d8-443b-9c25-c2b3cef304e0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:40.889106 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6aecb48-87d8-443b-9c25-c2b3cef304e0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:40.889537 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6aecb48-87d8-443b-9c25-c2b3cef304e0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:40.890208 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6aecb48-87d8-443b-9c25-c2b3cef304e0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:40.890682 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6aecb48-87d8-443b-9c25-c2b3cef304e0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:40.891099 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6aecb48-87d8-443b-9c25-c2b3cef304e0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:40.896282 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:41.023999 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d6aecb48-87d8-443b-9c25-c2b3cef304e0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:41.031441 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d6aecb48-87d8-443b-9c25-c2b3cef304e0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1367 microversion: 2.1 time: 0.155598 Sep 13 03:28:41.032001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 377/783] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:40 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:41.292635 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-073ae2ef-5eff-4bf9-87a6-ae3459fe14e9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:41.293216 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-073ae2ef-5eff-4bf9-87a6-ae3459fe14e9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:41.299252 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-073ae2ef-5eff-4bf9-87a6-ae3459fe14e9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:41.299740 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-073ae2ef-5eff-4bf9-87a6-ae3459fe14e9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:41.300180 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-073ae2ef-5eff-4bf9-87a6-ae3459fe14e9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:41.300869 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-073ae2ef-5eff-4bf9-87a6-ae3459fe14e9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:41.301327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-073ae2ef-5eff-4bf9-87a6-ae3459fe14e9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:41.301749 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-073ae2ef-5eff-4bf9-87a6-ae3459fe14e9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:41.487342 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-073ae2ef-5eff-4bf9-87a6-ae3459fe14e9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:41.495477 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-073ae2ef-5eff-4bf9-87a6-ae3459fe14e9 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.207031 Sep 13 03:28:41.496051 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 407/784] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:41 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:41.541638 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ddc98ec9-e383-498c-b8ef-32403d1a8f26 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:41.543934 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ddc98ec9-e383-498c-b8ef-32403d1a8f26 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:41.549662 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ddc98ec9-e383-498c-b8ef-32403d1a8f26 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:41.550142 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ddc98ec9-e383-498c-b8ef-32403d1a8f26 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:41.550574 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ddc98ec9-e383-498c-b8ef-32403d1a8f26 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:41.551303 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ddc98ec9-e383-498c-b8ef-32403d1a8f26 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:41.551751 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ddc98ec9-e383-498c-b8ef-32403d1a8f26 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:41.552170 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ddc98ec9-e383-498c-b8ef-32403d1a8f26 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:41.581106 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ddc98ec9-e383-498c-b8ef-32403d1a8f26 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043593 Sep 13 03:28:41.581670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 378/785] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 13 03:28:41 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:28:42.054442 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-37993b5e-bfbb-4042-9b73-329141895927 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:42.055106 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-37993b5e-bfbb-4042-9b73-329141895927 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:42.061060 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-37993b5e-bfbb-4042-9b73-329141895927 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:42.061551 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-37993b5e-bfbb-4042-9b73-329141895927 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:42.061985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-37993b5e-bfbb-4042-9b73-329141895927 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:42.062707 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-37993b5e-bfbb-4042-9b73-329141895927 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:42.063149 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-37993b5e-bfbb-4042-9b73-329141895927 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:42.063568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-37993b5e-bfbb-4042-9b73-329141895927 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:42.273578 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-37993b5e-bfbb-4042-9b73-329141895927 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:42.277056 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:42.282525 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-37993b5e-bfbb-4042-9b73-329141895927 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1367 microversion: 2.1 time: 0.233122 Sep 13 03:28:42.283272 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 408/786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:42 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:42.517990 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5eaf5539-253e-48f0-ad6b-02610219be7e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:42.518575 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5eaf5539-253e-48f0-ad6b-02610219be7e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:42.524882 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5eaf5539-253e-48f0-ad6b-02610219be7e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:42.525358 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5eaf5539-253e-48f0-ad6b-02610219be7e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:42.525787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5eaf5539-253e-48f0-ad6b-02610219be7e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:42.526462 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5eaf5539-253e-48f0-ad6b-02610219be7e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:42.526933 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5eaf5539-253e-48f0-ad6b-02610219be7e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:42.527342 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5eaf5539-253e-48f0-ad6b-02610219be7e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:42.593472 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-540e2fc7-97e6-4c81-a640-b9447b91d2bc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:42.595678 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-540e2fc7-97e6-4c81-a640-b9447b91d2bc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:42.602497 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-540e2fc7-97e6-4c81-a640-b9447b91d2bc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:42.603051 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-540e2fc7-97e6-4c81-a640-b9447b91d2bc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:42.603484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-540e2fc7-97e6-4c81-a640-b9447b91d2bc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:42.604406 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-540e2fc7-97e6-4c81-a640-b9447b91d2bc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:42.604722 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-540e2fc7-97e6-4c81-a640-b9447b91d2bc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:42.605150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-540e2fc7-97e6-4c81-a640-b9447b91d2bc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:42.634198 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-540e2fc7-97e6-4c81-a640-b9447b91d2bc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044664 Sep 13 03:28:42.634775 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 409/787] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 13 03:28:42 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:28:42.657412 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5eaf5539-253e-48f0-ad6b-02610219be7e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:42.666165 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5eaf5539-253e-48f0-ad6b-02610219be7e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.152012 Sep 13 03:28:42.666762 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 379/788] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:42 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:42.698892 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-67b2ffdd-497e-4448-9571-b7e014734e30 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:42.699433 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-67b2ffdd-497e-4448-9571-b7e014734e30 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:42.705567 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-67b2ffdd-497e-4448-9571-b7e014734e30 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:42.706061 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-67b2ffdd-497e-4448-9571-b7e014734e30 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:42.706502 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-67b2ffdd-497e-4448-9571-b7e014734e30 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:42.707229 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-67b2ffdd-497e-4448-9571-b7e014734e30 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:42.707689 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-67b2ffdd-497e-4448-9571-b7e014734e30 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:42.708117 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-67b2ffdd-497e-4448-9571-b7e014734e30 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:42.733119 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-67b2ffdd-497e-4448-9571-b7e014734e30 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Going to try to terminate instance {{(pid=120383) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:28:42.812776 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-67b2ffdd-497e-4448-9571-b7e014734e30 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 204 len: 0 microversion: 2.20 time: 0.117825 Sep 13 03:28:42.813386 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 410/789] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Sep 13 03:28:42 2022] DELETE /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 03:28:42.821719 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-58da725d-ce75-4349-93ad-b5e3d42aa19c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:42.822356 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-58da725d-ce75-4349-93ad-b5e3d42aa19c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:42.828187 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-58da725d-ce75-4349-93ad-b5e3d42aa19c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:42.828678 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-58da725d-ce75-4349-93ad-b5e3d42aa19c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:42.829113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-58da725d-ce75-4349-93ad-b5e3d42aa19c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:42.829803 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-58da725d-ce75-4349-93ad-b5e3d42aa19c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:42.830258 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-58da725d-ce75-4349-93ad-b5e3d42aa19c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:42.830839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-58da725d-ce75-4349-93ad-b5e3d42aa19c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:42.959401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-58da725d-ce75-4349-93ad-b5e3d42aa19c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:42.967402 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-58da725d-ce75-4349-93ad-b5e3d42aa19c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:42.968859 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-58da725d-ce75-4349-93ad-b5e3d42aa19c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:42.970001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-58da725d-ce75-4349-93ad-b5e3d42aa19c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.152276 Sep 13 03:28:42.970550 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 380/790] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:42 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:28:43.306250 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-63e7c451-a930-43e4-b110-a180b201820d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:43.306991 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-63e7c451-a930-43e4-b110-a180b201820d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:43.312751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-63e7c451-a930-43e4-b110-a180b201820d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:43.313228 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-63e7c451-a930-43e4-b110-a180b201820d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:43.313658 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-63e7c451-a930-43e4-b110-a180b201820d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:43.314334 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-63e7c451-a930-43e4-b110-a180b201820d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:43.314808 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-63e7c451-a930-43e4-b110-a180b201820d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:43.315225 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-63e7c451-a930-43e4-b110-a180b201820d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:43.445948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-63e7c451-a930-43e4-b110-a180b201820d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:43.453435 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-63e7c451-a930-43e4-b110-a180b201820d tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1367 microversion: 2.1 time: 0.151339 Sep 13 03:28:43.453997 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 411/791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:43 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:43.689090 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-75e17c6e-6ea9-4862-b535-cf653c6b4526 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:43.689685 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-75e17c6e-6ea9-4862-b535-cf653c6b4526 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:43.696589 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-75e17c6e-6ea9-4862-b535-cf653c6b4526 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:43.697065 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-75e17c6e-6ea9-4862-b535-cf653c6b4526 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:43.697492 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-75e17c6e-6ea9-4862-b535-cf653c6b4526 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:43.698165 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-75e17c6e-6ea9-4862-b535-cf653c6b4526 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:43.698633 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-75e17c6e-6ea9-4862-b535-cf653c6b4526 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:43.699050 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-75e17c6e-6ea9-4862-b535-cf653c6b4526 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:43.832233 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-75e17c6e-6ea9-4862-b535-cf653c6b4526 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:43.840249 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-75e17c6e-6ea9-4862-b535-cf653c6b4526 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.154937 Sep 13 03:28:43.840811 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 381/792] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:43 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:43.995230 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ac26d131-159d-47a8-be62-e588df66eff8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:43.995847 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ac26d131-159d-47a8-be62-e588df66eff8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:43.998278 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:43.998963 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=10 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:44.004887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ac26d131-159d-47a8-be62-e588df66eff8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:44.005376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ac26d131-159d-47a8-be62-e588df66eff8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:44.005874 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ac26d131-159d-47a8-be62-e588df66eff8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:44.006567 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ac26d131-159d-47a8-be62-e588df66eff8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:44.007049 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ac26d131-159d-47a8-be62-e588df66eff8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:44.007478 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ac26d131-159d-47a8-be62-e588df66eff8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:44.134360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ac26d131-159d-47a8-be62-e588df66eff8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:44.142433 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ac26d131-159d-47a8-be62-e588df66eff8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:44.143909 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ac26d131-159d-47a8-be62-e588df66eff8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:44.145105 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ac26d131-159d-47a8-be62-e588df66eff8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.153804 Sep 13 03:28:44.145666 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 412/793] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:43 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:28:44.475907 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-231c4f47-d285-42b6-bb9a-3675a24c6f62 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:44.476519 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-231c4f47-d285-42b6-bb9a-3675a24c6f62 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:44.478326 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:44.483695 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-231c4f47-d285-42b6-bb9a-3675a24c6f62 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:44.484218 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-231c4f47-d285-42b6-bb9a-3675a24c6f62 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:44.484652 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-231c4f47-d285-42b6-bb9a-3675a24c6f62 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:44.485335 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-231c4f47-d285-42b6-bb9a-3675a24c6f62 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:44.485787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-231c4f47-d285-42b6-bb9a-3675a24c6f62 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:44.486207 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-231c4f47-d285-42b6-bb9a-3675a24c6f62 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:44.616754 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-231c4f47-d285-42b6-bb9a-3675a24c6f62 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:44.624270 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-231c4f47-d285-42b6-bb9a-3675a24c6f62 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1367 microversion: 2.1 time: 0.152876 Sep 13 03:28:44.625029 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 382/794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:44 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:44.862738 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6a5405db-8c44-4d63-9916-495258b6c21d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:44.863308 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6a5405db-8c44-4d63-9916-495258b6c21d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:44.869245 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a5405db-8c44-4d63-9916-495258b6c21d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:44.869729 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a5405db-8c44-4d63-9916-495258b6c21d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:44.870161 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a5405db-8c44-4d63-9916-495258b6c21d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:44.870867 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a5405db-8c44-4d63-9916-495258b6c21d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:44.871326 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a5405db-8c44-4d63-9916-495258b6c21d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:44.871746 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a5405db-8c44-4d63-9916-495258b6c21d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:45.080006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6a5405db-8c44-4d63-9916-495258b6c21d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:45.087867 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6a5405db-8c44-4d63-9916-495258b6c21d tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.229003 Sep 13 03:28:45.088447 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 413/795] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:44 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:28:45.170005 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a812c4c4-bc16-4dab-91a9-ef426b13dd36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:45.170650 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a812c4c4-bc16-4dab-91a9-ef426b13dd36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:45.177500 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a812c4c4-bc16-4dab-91a9-ef426b13dd36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:45.177985 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a812c4c4-bc16-4dab-91a9-ef426b13dd36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:45.178414 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a812c4c4-bc16-4dab-91a9-ef426b13dd36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:45.179134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a812c4c4-bc16-4dab-91a9-ef426b13dd36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:45.179585 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a812c4c4-bc16-4dab-91a9-ef426b13dd36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:45.180005 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a812c4c4-bc16-4dab-91a9-ef426b13dd36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:45.328891 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a812c4c4-bc16-4dab-91a9-ef426b13dd36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:45.337656 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a812c4c4-bc16-4dab-91a9-ef426b13dd36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:45.338717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a812c4c4-bc16-4dab-91a9-ef426b13dd36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:45.339878 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a812c4c4-bc16-4dab-91a9-ef426b13dd36 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1723 microversion: 2.20 time: 0.173737 Sep 13 03:28:45.340436 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 383/796] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:45 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:28:45.373812 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-6bf8ffae-b854-4fdc-91b7-7ecfb714d821 req-63d4f674-2699-4bdf-aaa7-d7f0cd918607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0446c67-3992-4af8-9863-0eed6088d0a7", "name": "network-vif-plugged", "status": "completed", "tag": "bd04d4b1-89e1-4671-a828-65eb8d1e5eab"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:45.384625 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6bf8ffae-b854-4fdc-91b7-7ecfb714d821 req-63d4f674-2699-4bdf-aaa7-d7f0cd918607 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:45.385115 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6bf8ffae-b854-4fdc-91b7-7ecfb714d821 req-63d4f674-2699-4bdf-aaa7-d7f0cd918607 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:45.385551 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6bf8ffae-b854-4fdc-91b7-7ecfb714d821 req-63d4f674-2699-4bdf-aaa7-d7f0cd918607 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:45.398952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-6bf8ffae-b854-4fdc-91b7-7ecfb714d821 req-63d4f674-2699-4bdf-aaa7-d7f0cd918607 service nova] Creating event network-vif-plugged:bd04d4b1-89e1-4671-a828-65eb8d1e5eab for instance d0446c67-3992-4af8-9863-0eed6088d0a7 on hv-cinder-85707 Sep 13 03:28:45.412612 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-6bf8ffae-b854-4fdc-91b7-7ecfb714d821 req-63d4f674-2699-4bdf-aaa7-d7f0cd918607 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041980 Sep 13 03:28:45.413325 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 414/797] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:28:45.649329 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2e8cf6a1-a8b6-4281-b665-ff5e96ba5fe0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:45.650406 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2e8cf6a1-a8b6-4281-b665-ff5e96ba5fe0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:45.663953 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e8cf6a1-a8b6-4281-b665-ff5e96ba5fe0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:45.664450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e8cf6a1-a8b6-4281-b665-ff5e96ba5fe0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:45.664880 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e8cf6a1-a8b6-4281-b665-ff5e96ba5fe0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:45.665831 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e8cf6a1-a8b6-4281-b665-ff5e96ba5fe0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:45.666279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e8cf6a1-a8b6-4281-b665-ff5e96ba5fe0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:45.666722 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2e8cf6a1-a8b6-4281-b665-ff5e96ba5fe0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:45.795575 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2e8cf6a1-a8b6-4281-b665-ff5e96ba5fe0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:45.803890 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2e8cf6a1-a8b6-4281-b665-ff5e96ba5fe0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1367 microversion: 2.1 time: 0.159650 Sep 13 03:28:45.804394 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 384/798] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:45 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:45.876593 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-ebea96ec-1450-43d0-a3aa-f4faa8fd6630 req-2b6afd34-03b1-4465-94d1-febbe518d39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97f011a-6370-474e-9a62-e9229eb7d7ee", "name": "network-vif-deleted", "tag": "1c922edb-7dd6-4a91-ba67-004272056f1c"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:45.887033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-ebea96ec-1450-43d0-a3aa-f4faa8fd6630 req-2b6afd34-03b1-4465-94d1-febbe518d39c service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:45.887513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-ebea96ec-1450-43d0-a3aa-f4faa8fd6630 req-2b6afd34-03b1-4465-94d1-febbe518d39c service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:45.887945 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-ebea96ec-1450-43d0-a3aa-f4faa8fd6630 req-2b6afd34-03b1-4465-94d1-febbe518d39c service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:45.899350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-ebea96ec-1450-43d0-a3aa-f4faa8fd6630 req-2b6afd34-03b1-4465-94d1-febbe518d39c service nova] Creating event network-vif-deleted:1c922edb-7dd6-4a91-ba67-004272056f1c for instance a97f011a-6370-474e-9a62-e9229eb7d7ee on hv-cinder-85707 Sep 13 03:28:45.904237 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-ebea96ec-1450-43d0-a3aa-f4faa8fd6630 req-2b6afd34-03b1-4465-94d1-febbe518d39c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031796 Sep 13 03:28:45.904827 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 415/799] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:28:46.110426 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-65c5af1a-09a1-4f05-8d28-58fc2d6ae355 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:46.111079 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-65c5af1a-09a1-4f05-8d28-58fc2d6ae355 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:46.117660 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-65c5af1a-09a1-4f05-8d28-58fc2d6ae355 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:46.118151 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-65c5af1a-09a1-4f05-8d28-58fc2d6ae355 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:46.118593 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-65c5af1a-09a1-4f05-8d28-58fc2d6ae355 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:46.119306 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-65c5af1a-09a1-4f05-8d28-58fc2d6ae355 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:46.119764 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-65c5af1a-09a1-4f05-8d28-58fc2d6ae355 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:46.120186 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-65c5af1a-09a1-4f05-8d28-58fc2d6ae355 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:46.260793 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-65c5af1a-09a1-4f05-8d28-58fc2d6ae355 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:46.268527 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-65c5af1a-09a1-4f05-8d28-58fc2d6ae355 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.162036 Sep 13 03:28:46.269539 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 385/800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:46 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:46.366864 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c6476921-622c-426f-9c54-f033a5fed45e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:46.367555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c6476921-622c-426f-9c54-f033a5fed45e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:46.373658 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6476921-622c-426f-9c54-f033a5fed45e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:46.374136 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6476921-622c-426f-9c54-f033a5fed45e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:46.374573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6476921-622c-426f-9c54-f033a5fed45e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:46.375275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6476921-622c-426f-9c54-f033a5fed45e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:46.375725 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6476921-622c-426f-9c54-f033a5fed45e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:46.376143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6476921-622c-426f-9c54-f033a5fed45e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:46.438701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c6476921-622c-426f-9c54-f033a5fed45e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:46.447470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c6476921-622c-426f-9c54-f033a5fed45e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:46.448826 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c6476921-622c-426f-9c54-f033a5fed45e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:46.449974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c6476921-622c-426f-9c54-f033a5fed45e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1367 microversion: 2.20 time: 0.088398 Sep 13 03:28:46.450505 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 416/801] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:46 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:28:46.827301 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6e5cb20c-5189-468a-8814-e08f05c782d7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:46.828193 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6e5cb20c-5189-468a-8814-e08f05c782d7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:46.834957 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6e5cb20c-5189-468a-8814-e08f05c782d7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:46.835657 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6e5cb20c-5189-468a-8814-e08f05c782d7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:46.836270 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6e5cb20c-5189-468a-8814-e08f05c782d7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:46.836971 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6e5cb20c-5189-468a-8814-e08f05c782d7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:46.837523 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6e5cb20c-5189-468a-8814-e08f05c782d7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:46.838351 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6e5cb20c-5189-468a-8814-e08f05c782d7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:46.980776 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-6e5cb20c-5189-468a-8814-e08f05c782d7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:46.988765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6e5cb20c-5189-468a-8814-e08f05c782d7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1367 microversion: 2.1 time: 0.165167 Sep 13 03:28:46.989268 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 386/802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:46 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:47.291670 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-edc04e8f-4e25-4c97-b2cf-b1f2c5c51c5e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:47.292277 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-edc04e8f-4e25-4c97-b2cf-b1f2c5c51c5e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:47.298249 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-edc04e8f-4e25-4c97-b2cf-b1f2c5c51c5e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:47.298791 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-edc04e8f-4e25-4c97-b2cf-b1f2c5c51c5e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:47.299248 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-edc04e8f-4e25-4c97-b2cf-b1f2c5c51c5e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:47.300106 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-edc04e8f-4e25-4c97-b2cf-b1f2c5c51c5e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:47.300560 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-edc04e8f-4e25-4c97-b2cf-b1f2c5c51c5e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:47.301009 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-edc04e8f-4e25-4c97-b2cf-b1f2c5c51c5e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:47.429286 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-edc04e8f-4e25-4c97-b2cf-b1f2c5c51c5e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:47.437104 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-edc04e8f-4e25-4c97-b2cf-b1f2c5c51c5e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.149526 Sep 13 03:28:47.437301 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-4dfac29c-63bb-48e7-a54f-b7c9eca90b89 req-9e17919c-9a71-45ec-a47b-9375ea4b20d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae88f2e-fe4e-46c6-bf5a-0381e90e26c6", "name": "network-vif-plugged", "status": "completed", "tag": "802c0f2a-3726-4731-b295-4046e1e4707e"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:47.437739 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 417/803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:47 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:47.447914 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-4dfac29c-63bb-48e7-a54f-b7c9eca90b89 req-9e17919c-9a71-45ec-a47b-9375ea4b20d2 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:47.448365 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-4dfac29c-63bb-48e7-a54f-b7c9eca90b89 req-9e17919c-9a71-45ec-a47b-9375ea4b20d2 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:47.448791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-4dfac29c-63bb-48e7-a54f-b7c9eca90b89 req-9e17919c-9a71-45ec-a47b-9375ea4b20d2 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:47.459677 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-4dfac29c-63bb-48e7-a54f-b7c9eca90b89 req-9e17919c-9a71-45ec-a47b-9375ea4b20d2 service nova] Creating event network-vif-plugged:802c0f2a-3726-4731-b295-4046e1e4707e for instance aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 on hv-cinder-85707 Sep 13 03:28:47.464478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-4dfac29c-63bb-48e7-a54f-b7c9eca90b89 req-9e17919c-9a71-45ec-a47b-9375ea4b20d2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030842 Sep 13 03:28:47.465037 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 387/804] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:28:47.474712 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:47.475316 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:47.481183 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:47.481656 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:47.482091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:47.482793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:47.483244 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:47.483660 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:47.513559 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:47.514027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:47.514455 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:47.514922 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lazy-loading 'fault' on Instance uuid a97f011a-6370-474e-9a62-e9229eb7d7ee {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:28:47.556975 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:47.564854 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:47.566283 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:47.568078 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-34929e25-54ad-4166-bbf4-4d9af78c9c5b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 200 len: 1372 microversion: 2.20 time: 0.097142 Sep 13 03:28:47.568626 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 418/805] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:47 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:28:48.011610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ac61d714-2b91-4da4-81e3-f02fc8d6e786 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:48.012393 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ac61d714-2b91-4da4-81e3-f02fc8d6e786 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:48.018597 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ac61d714-2b91-4da4-81e3-f02fc8d6e786 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:48.019113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ac61d714-2b91-4da4-81e3-f02fc8d6e786 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:48.019556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ac61d714-2b91-4da4-81e3-f02fc8d6e786 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:48.020739 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ac61d714-2b91-4da4-81e3-f02fc8d6e786 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:48.021194 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ac61d714-2b91-4da4-81e3-f02fc8d6e786 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:48.021617 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ac61d714-2b91-4da4-81e3-f02fc8d6e786 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:48.163215 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ac61d714-2b91-4da4-81e3-f02fc8d6e786 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:48.171273 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ac61d714-2b91-4da4-81e3-f02fc8d6e786 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1558 microversion: 2.1 time: 0.163815 Sep 13 03:28:48.171840 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 388/806] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:48 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:48.193648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8d7eb91d-6fcf-46f0-b846-940f8eb85831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:48.194445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8d7eb91d-6fcf-46f0-b846-940f8eb85831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:48.200501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8d7eb91d-6fcf-46f0-b846-940f8eb85831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:48.201225 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8d7eb91d-6fcf-46f0-b846-940f8eb85831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:48.201852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8d7eb91d-6fcf-46f0-b846-940f8eb85831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:48.202857 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8d7eb91d-6fcf-46f0-b846-940f8eb85831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:48.203525 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8d7eb91d-6fcf-46f0-b846-940f8eb85831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:48.204243 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8d7eb91d-6fcf-46f0-b846-940f8eb85831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:48.318370 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8d7eb91d-6fcf-46f0-b846-940f8eb85831 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128674 Sep 13 03:28:48.319031 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 419/807] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 03:28:48 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:28:48.460864 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-93145898-10ad-49e6-8720-d56e1b91e291 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:48.461486 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-93145898-10ad-49e6-8720-d56e1b91e291 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:48.468015 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-93145898-10ad-49e6-8720-d56e1b91e291 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:48.468509 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-93145898-10ad-49e6-8720-d56e1b91e291 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:48.468946 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-93145898-10ad-49e6-8720-d56e1b91e291 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:48.469646 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-93145898-10ad-49e6-8720-d56e1b91e291 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:48.470103 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-93145898-10ad-49e6-8720-d56e1b91e291 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:48.470550 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-93145898-10ad-49e6-8720-d56e1b91e291 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:48.593306 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-670a5a8e-e73d-40a2-aa7d-3215a079c920 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:48.593838 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-670a5a8e-e73d-40a2-aa7d-3215a079c920 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:48.599872 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-670a5a8e-e73d-40a2-aa7d-3215a079c920 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:48.600360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-670a5a8e-e73d-40a2-aa7d-3215a079c920 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:48.600789 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-670a5a8e-e73d-40a2-aa7d-3215a079c920 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:48.601670 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-670a5a8e-e73d-40a2-aa7d-3215a079c920 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:48.602130 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-670a5a8e-e73d-40a2-aa7d-3215a079c920 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:48.602549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-670a5a8e-e73d-40a2-aa7d-3215a079c920 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:48.616411 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-670a5a8e-e73d-40a2-aa7d-3215a079c920 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] HTTP exception thrown: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-670a5a8e-e73d-40a2-aa7d-3215a079c920 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Request method failure captured: Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee HTTP/1.1 Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cWOLycv9HLDQnyk31FgNef0ShqRhwvzEZRKAdMOVFz_Xpr7-T4pqZEOUUi3ruNkNxuZCxpSWFTKnvlbdgUUEqS6aW8tzLibvJLYXRrxhJz0KVv5qhZGHohvxzimtpKLMIO_X6JdECuzh_aTx9hfHBXs_x6eCqIMTWmHhSNl1U_A_k Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 9b7c5a1fd8a24526b7859fdb030ccb95 Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:28:48.618128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:28:48.619677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b7c5a1fd8a24526b7859fdb030ccb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b7c5a1fd8a24526b7859fdb030ccb95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b7c5a1fd8a24526b7859fdb030ccb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b7c5a1fd8a24526b7859fdb030ccb95"}]}] Sep 13 03:28:48.619677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:28:48.619677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 9b7c5a1fd8a24526b7859fdb030ccb95 Sep 13 03:28:48.619677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:28:48.619677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-AttachVolumeShelveTestJSON-2106680885-project Sep 13 03:28:48.619677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:28:48.619677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:28:48.619677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 83bd9ab163ba4229bcfd810345430564 Sep 13 03:28:48.619677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2106680885-project Sep 13 03:28:48.619677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:28:48.619677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:28:48.619677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'a97f011a-6370-474e-9a62-e9229eb7d7ee'} Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:28:48.620479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:28:48.621769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:28:48.622963 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-670a5a8e-e73d-40a2-aa7d-3215a079c920 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Returning 404 to user: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:28:48.622963 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-670a5a8e-e73d-40a2-aa7d-3215a079c920 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 404 len: 111 microversion: 2.20 time: 0.030743 Sep 13 03:28:48.622963 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 420/808] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:48 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 03:28:48.628521 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-60ac1e49-fa57-4a3c-99ba-ca167d37fe5f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '.version_select at 0x7f89367c2ee0>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:48.647693 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-60ac1e49-fa57-4a3c-99ba-ca167d37fe5f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907370066" status: 204 len: 0 microversion: 2.20 time: 0.022737 Sep 13 03:28:48.648285 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 421/809] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Sep 13 03:28:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907370066 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 03:28:48.732592 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-93145898-10ad-49e6-8720-d56e1b91e291 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:48.741310 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-93145898-10ad-49e6-8720-d56e1b91e291 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.284895 Sep 13 03:28:48.741898 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 389/810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:48 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:49.313001 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cf680c38-0c3a-48f5-a067-820a022d192f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Action: 'create', calling method: .version_select at 0x7f89356e19d0>, body: {"keypair": {"name": "tempest-keypair-1778160679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClxjw8KNC2jBXuzvxAcnPrXkI+HuS7IqCMP8PAKKPt7rx9dhdFUSBfzL9mgfI7I4i+lG+BTplVDXNfevgzEk34rIzYUU4dq5CHMdyJqsrWKYkLUHiclcGsDblGVlc1FsA=="}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:49.333683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-cf680c38-0c3a-48f5-a067-820a022d192f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Getting quotas for project 9b7c5a1fd8a24526b7859fdb030ccb95. Resources: {'key_pairs'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:28:49.338688 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-cf680c38-0c3a-48f5-a067-820a022d192f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Getting quotas for user 83bd9ab163ba4229bcfd810345430564 and project 9b7c5a1fd8a24526b7859fdb030ccb95. Resources: {'key_pairs'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:28:49.352554 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-f94adcd5-c647-440f-8ef9-3fb0de0d739c req-7373ac2f-65ca-4383-bb0d-eaab928edcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0446c67-3992-4af8-9863-0eed6088d0a7", "tag": "bd04d4b1-89e1-4671-a828-65eb8d1e5eab"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:49.363200 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-f94adcd5-c647-440f-8ef9-3fb0de0d739c req-7373ac2f-65ca-4383-bb0d-eaab928edcb6 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:49.364595 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-f94adcd5-c647-440f-8ef9-3fb0de0d739c req-7373ac2f-65ca-4383-bb0d-eaab928edcb6 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:49.365262 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-f94adcd5-c647-440f-8ef9-3fb0de0d739c req-7373ac2f-65ca-4383-bb0d-eaab928edcb6 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:49.369565 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-cf680c38-0c3a-48f5-a067-820a022d192f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.061156 Sep 13 03:28:49.370582 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 422/811] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Sep 13 03:28:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 03:28:49.378475 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-f94adcd5-c647-440f-8ef9-3fb0de0d739c req-7373ac2f-65ca-4383-bb0d-eaab928edcb6 service nova] Creating event network-changed:bd04d4b1-89e1-4671-a828-65eb8d1e5eab for instance d0446c67-3992-4af8-9863-0eed6088d0a7 on hv-cinder-85707 Sep 13 03:28:49.383974 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-f94adcd5-c647-440f-8ef9-3fb0de0d739c req-7373ac2f-65ca-4383-bb0d-eaab928edcb6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035383 Sep 13 03:28:49.385167 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 390/812] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:28:49.765903 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-60d5721a-43be-483f-81a9-f2c8cbf30ce7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:49.766511 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-60d5721a-43be-483f-81a9-f2c8cbf30ce7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:49.773047 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60d5721a-43be-483f-81a9-f2c8cbf30ce7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:49.773543 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60d5721a-43be-483f-81a9-f2c8cbf30ce7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:49.773986 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60d5721a-43be-483f-81a9-f2c8cbf30ce7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:49.774834 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60d5721a-43be-483f-81a9-f2c8cbf30ce7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:49.775454 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60d5721a-43be-483f-81a9-f2c8cbf30ce7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:49.776039 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-60d5721a-43be-483f-81a9-f2c8cbf30ce7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:49.951228 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-60d5721a-43be-483f-81a9-f2c8cbf30ce7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:49.960065 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-60d5721a-43be-483f-81a9-f2c8cbf30ce7 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1575 microversion: 2.1 time: 0.198933 Sep 13 03:28:49.961028 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 423/813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:49 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:28:50.984491 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-85f2d615-5ab3-4e88-8ffc-a8faed11b6dd tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:50.985185 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-85f2d615-5ab3-4e88-8ffc-a8faed11b6dd tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:50.991699 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-85f2d615-5ab3-4e88-8ffc-a8faed11b6dd tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:50.992194 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-85f2d615-5ab3-4e88-8ffc-a8faed11b6dd tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:50.992622 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-85f2d615-5ab3-4e88-8ffc-a8faed11b6dd tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:50.993465 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-85f2d615-5ab3-4e88-8ffc-a8faed11b6dd tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:50.994077 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-85f2d615-5ab3-4e88-8ffc-a8faed11b6dd tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:50.994498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-85f2d615-5ab3-4e88-8ffc-a8faed11b6dd tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:51.045222 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1068901587", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7e1950a0-7f6c-4538-86e4-23311290e33c"}], "security_groups": [{"name": "tempest-securitygroup--18744234"}], "key_name": "tempest-keypair-1778160679", "user_data": "}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:51.130978 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-85f2d615-5ab3-4e88-8ffc-a8faed11b6dd tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:51.138858 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-85f2d615-5ab3-4e88-8ffc-a8faed11b6dd tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1562 microversion: 2.1 time: 0.159001 Sep 13 03:28:51.139442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 391/814] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:28:50 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:28:51.151181 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.network.neutron [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] validate_networks() for [('7e1950a0-7f6c-4538-86e4-23311290e33c', None, None, None, None, None)] {{(pid=120383) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:28:51.511690 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Flavor limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:28:51.512115 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Image limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:28:51.512580 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Flavor pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:28:51.512981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Image pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:28:51.513387 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:28:51.522063 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:51.522534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:51.522988 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:51.523712 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:51.524159 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:51.524578 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:51.541144 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Getting quotas for project 9b7c5a1fd8a24526b7859fdb030ccb95. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:28:51.544972 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Getting quotas for user 83bd9ab163ba4229bcfd810345430564 and project 9b7c5a1fd8a24526b7859fdb030ccb95. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:28:51.556088 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Going to run 1 instances... {{(pid=120383) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:28:51.558335 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:28:51.604321 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3e066612-670d-4f67-9b0e-f7d453ee565f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.563393 Sep 13 03:28:51.604985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 424/815] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Sep 13 03:28:51 2022] POST /compute/v2.1/servers => generated 400 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 13 03:28:51.616621 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a37f11db-93cd-4043-878e-a0d91cff3500 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:51.617255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a37f11db-93cd-4043-878e-a0d91cff3500 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:51.669232 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a37f11db-93cd-4043-878e-a0d91cff3500 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:51.677134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a37f11db-93cd-4043-878e-a0d91cff3500 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:51.678634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a37f11db-93cd-4043-878e-a0d91cff3500 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:51.679883 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a37f11db-93cd-4043-878e-a0d91cff3500 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1282 microversion: 2.20 time: 0.067836 Sep 13 03:28:51.680454 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 392/816] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:51 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1282 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:28:52.704641 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ec3553e4-2d34-49df-88ab-9f48105c8605 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:52.705244 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ec3553e4-2d34-49df-88ab-9f48105c8605 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:52.712980 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ec3553e4-2d34-49df-88ab-9f48105c8605 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:52.713459 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ec3553e4-2d34-49df-88ab-9f48105c8605 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:52.713888 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ec3553e4-2d34-49df-88ab-9f48105c8605 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:52.714566 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ec3553e4-2d34-49df-88ab-9f48105c8605 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:52.715046 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ec3553e4-2d34-49df-88ab-9f48105c8605 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:52.715468 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ec3553e4-2d34-49df-88ab-9f48105c8605 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:52.775444 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ec3553e4-2d34-49df-88ab-9f48105c8605 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:52.783389 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ec3553e4-2d34-49df-88ab-9f48105c8605 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:52.784820 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ec3553e4-2d34-49df-88ab-9f48105c8605 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:52.785934 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ec3553e4-2d34-49df-88ab-9f48105c8605 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1334 microversion: 2.20 time: 0.085690 Sep 13 03:28:52.786471 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 425/817] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:52 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1334 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:28:53.811373 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-19836de6-463c-4da6-8277-52556a2ee5bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:53.811992 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-19836de6-463c-4da6-8277-52556a2ee5bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:53.818918 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19836de6-463c-4da6-8277-52556a2ee5bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:53.819411 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19836de6-463c-4da6-8277-52556a2ee5bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:53.819847 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19836de6-463c-4da6-8277-52556a2ee5bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:53.820533 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19836de6-463c-4da6-8277-52556a2ee5bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:53.821053 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19836de6-463c-4da6-8277-52556a2ee5bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:53.821592 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-19836de6-463c-4da6-8277-52556a2ee5bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:53.956042 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-19836de6-463c-4da6-8277-52556a2ee5bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:53.964877 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-19836de6-463c-4da6-8277-52556a2ee5bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:53.966332 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-19836de6-463c-4da6-8277-52556a2ee5bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:53.967466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-19836de6-463c-4da6-8277-52556a2ee5bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1406 microversion: 2.20 time: 0.160115 Sep 13 03:28:53.968028 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 393/818] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:53 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:28:54.367265 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-bcc1b8dd-4cc3-4a8a-837d-60cb2ca81ea7 req-2fa6c6af-24dd-4bc0-b2aa-0b3cb66f205d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a712d2c4-a489-45e8-941a-13abba66403c", "tag": "1b4bf2a7-2e87-4a14-894c-d018f847fb5b"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:28:54.378193 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-bcc1b8dd-4cc3-4a8a-837d-60cb2ca81ea7 req-2fa6c6af-24dd-4bc0-b2aa-0b3cb66f205d service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:54.378702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-bcc1b8dd-4cc3-4a8a-837d-60cb2ca81ea7 req-2fa6c6af-24dd-4bc0-b2aa-0b3cb66f205d service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:54.379343 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-bcc1b8dd-4cc3-4a8a-837d-60cb2ca81ea7 req-2fa6c6af-24dd-4bc0-b2aa-0b3cb66f205d service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:54.390663 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-bcc1b8dd-4cc3-4a8a-837d-60cb2ca81ea7 req-2fa6c6af-24dd-4bc0-b2aa-0b3cb66f205d service nova] Creating event network-changed:1b4bf2a7-2e87-4a14-894c-d018f847fb5b for instance a712d2c4-a489-45e8-941a-13abba66403c on hv-cinder-85707 Sep 13 03:28:54.395534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-bcc1b8dd-4cc3-4a8a-837d-60cb2ca81ea7 req-2fa6c6af-24dd-4bc0-b2aa-0b3cb66f205d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032678 Sep 13 03:28:54.396126 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 426/819] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:28:54.992387 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b39954a6-e9dc-4602-8300-b95b73e14867 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:54.992990 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b39954a6-e9dc-4602-8300-b95b73e14867 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:54.999284 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b39954a6-e9dc-4602-8300-b95b73e14867 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:54.999766 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b39954a6-e9dc-4602-8300-b95b73e14867 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:55.000194 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b39954a6-e9dc-4602-8300-b95b73e14867 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:55.000873 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b39954a6-e9dc-4602-8300-b95b73e14867 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:55.001324 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b39954a6-e9dc-4602-8300-b95b73e14867 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:55.001737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b39954a6-e9dc-4602-8300-b95b73e14867 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:55.131106 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b39954a6-e9dc-4602-8300-b95b73e14867 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:55.139121 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b39954a6-e9dc-4602-8300-b95b73e14867 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:55.140539 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b39954a6-e9dc-4602-8300-b95b73e14867 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:55.141632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b39954a6-e9dc-4602-8300-b95b73e14867 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1406 microversion: 2.20 time: 0.153132 Sep 13 03:28:55.142188 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 394/820] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:54 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:28:56.167962 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2a46cbeb-dedf-4073-878c-251ddfcbbc0a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:56.168684 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2a46cbeb-dedf-4073-878c-251ddfcbbc0a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:56.174838 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a46cbeb-dedf-4073-878c-251ddfcbbc0a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:56.175316 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a46cbeb-dedf-4073-878c-251ddfcbbc0a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:56.175749 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a46cbeb-dedf-4073-878c-251ddfcbbc0a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:56.177067 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a46cbeb-dedf-4073-878c-251ddfcbbc0a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:56.177515 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a46cbeb-dedf-4073-878c-251ddfcbbc0a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:56.177935 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2a46cbeb-dedf-4073-878c-251ddfcbbc0a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:56.309490 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2a46cbeb-dedf-4073-878c-251ddfcbbc0a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:56.317477 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2a46cbeb-dedf-4073-878c-251ddfcbbc0a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:56.318920 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2a46cbeb-dedf-4073-878c-251ddfcbbc0a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:56.320010 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2a46cbeb-dedf-4073-878c-251ddfcbbc0a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1406 microversion: 2.20 time: 0.157151 Sep 13 03:28:56.320560 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 427/821] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:56 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:28:57.345259 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9d4a94e9-41fd-4bdb-9ffb-6f06fdffdc50 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:57.345798 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9d4a94e9-41fd-4bdb-9ffb-6f06fdffdc50 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:57.352655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9d4a94e9-41fd-4bdb-9ffb-6f06fdffdc50 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:57.353384 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9d4a94e9-41fd-4bdb-9ffb-6f06fdffdc50 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:57.353821 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9d4a94e9-41fd-4bdb-9ffb-6f06fdffdc50 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:57.354503 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9d4a94e9-41fd-4bdb-9ffb-6f06fdffdc50 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:57.354980 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9d4a94e9-41fd-4bdb-9ffb-6f06fdffdc50 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:57.355396 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9d4a94e9-41fd-4bdb-9ffb-6f06fdffdc50 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:57.482670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9d4a94e9-41fd-4bdb-9ffb-6f06fdffdc50 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:57.491428 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9d4a94e9-41fd-4bdb-9ffb-6f06fdffdc50 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:57.492854 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9d4a94e9-41fd-4bdb-9ffb-6f06fdffdc50 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:57.493946 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9d4a94e9-41fd-4bdb-9ffb-6f06fdffdc50 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1406 microversion: 2.20 time: 0.152757 Sep 13 03:28:57.494500 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 395/822] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:57 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:28:58.517331 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7af91ee5-9d84-413d-9e0e-f16a00b9dd79 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:58.517938 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7af91ee5-9d84-413d-9e0e-f16a00b9dd79 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:58.524614 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7af91ee5-9d84-413d-9e0e-f16a00b9dd79 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:58.525111 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7af91ee5-9d84-413d-9e0e-f16a00b9dd79 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:58.525615 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7af91ee5-9d84-413d-9e0e-f16a00b9dd79 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:58.526307 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7af91ee5-9d84-413d-9e0e-f16a00b9dd79 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:58.526799 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7af91ee5-9d84-413d-9e0e-f16a00b9dd79 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:58.527224 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7af91ee5-9d84-413d-9e0e-f16a00b9dd79 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:58.741643 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7af91ee5-9d84-413d-9e0e-f16a00b9dd79 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:58.750229 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7af91ee5-9d84-413d-9e0e-f16a00b9dd79 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:58.751710 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7af91ee5-9d84-413d-9e0e-f16a00b9dd79 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:58.752815 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7af91ee5-9d84-413d-9e0e-f16a00b9dd79 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1406 microversion: 2.20 time: 0.239436 Sep 13 03:28:58.753378 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 428/823] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:58 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:28:59.777497 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-32b1629b-a468-49c4-8c2c-a5adc7dfc4b0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:28:59.778096 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-32b1629b-a468-49c4-8c2c-a5adc7dfc4b0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:28:59.784447 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-32b1629b-a468-49c4-8c2c-a5adc7dfc4b0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:59.784926 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-32b1629b-a468-49c4-8c2c-a5adc7dfc4b0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:59.785359 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-32b1629b-a468-49c4-8c2c-a5adc7dfc4b0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:59.786035 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-32b1629b-a468-49c4-8c2c-a5adc7dfc4b0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:28:59.786481 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-32b1629b-a468-49c4-8c2c-a5adc7dfc4b0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:28:59.786926 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-32b1629b-a468-49c4-8c2c-a5adc7dfc4b0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:28:59.791254 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=100 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:59.928690 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-32b1629b-a468-49c4-8c2c-a5adc7dfc4b0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:59.936631 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-32b1629b-a468-49c4-8c2c-a5adc7dfc4b0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:59.938064 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-32b1629b-a468-49c4-8c2c-a5adc7dfc4b0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:28:59.939197 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-32b1629b-a468-49c4-8c2c-a5adc7dfc4b0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1406 microversion: 2.20 time: 0.165573 Sep 13 03:28:59.939766 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 396/824] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:28:59 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:29:00.341740 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-965a2303-8364-49e4-be4e-40ccbf32ca2d req-0e5f0627-fb6b-4480-98e4-624567fdf66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a712d2c4-a489-45e8-941a-13abba66403c", "name": "network-vif-plugged", "status": "completed", "tag": "1b4bf2a7-2e87-4a14-894c-d018f847fb5b"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:00.352359 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-965a2303-8364-49e4-be4e-40ccbf32ca2d req-0e5f0627-fb6b-4480-98e4-624567fdf66f service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:00.352816 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-965a2303-8364-49e4-be4e-40ccbf32ca2d req-0e5f0627-fb6b-4480-98e4-624567fdf66f service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:00.353262 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-965a2303-8364-49e4-be4e-40ccbf32ca2d req-0e5f0627-fb6b-4480-98e4-624567fdf66f service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:00.357262 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:00.366650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-965a2303-8364-49e4-be4e-40ccbf32ca2d req-0e5f0627-fb6b-4480-98e4-624567fdf66f service nova] Creating event network-vif-plugged:1b4bf2a7-2e87-4a14-894c-d018f847fb5b for instance a712d2c4-a489-45e8-941a-13abba66403c on hv-cinder-85707 Sep 13 03:29:00.371595 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-965a2303-8364-49e4-be4e-40ccbf32ca2d req-0e5f0627-fb6b-4480-98e4-624567fdf66f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033461 Sep 13 03:29:00.372255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 429/825] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:29:00.964332 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a95832fc-6ada-4500-8694-8f8ad73108cd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:00.964943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a95832fc-6ada-4500-8694-8f8ad73108cd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:00.971325 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a95832fc-6ada-4500-8694-8f8ad73108cd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:00.971801 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a95832fc-6ada-4500-8694-8f8ad73108cd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:00.972237 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a95832fc-6ada-4500-8694-8f8ad73108cd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:00.973489 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a95832fc-6ada-4500-8694-8f8ad73108cd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:00.973938 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a95832fc-6ada-4500-8694-8f8ad73108cd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:00.974356 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a95832fc-6ada-4500-8694-8f8ad73108cd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:01.102294 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a95832fc-6ada-4500-8694-8f8ad73108cd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:01.110331 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a95832fc-6ada-4500-8694-8f8ad73108cd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:01.111796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a95832fc-6ada-4500-8694-8f8ad73108cd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:01.112885 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a95832fc-6ada-4500-8694-8f8ad73108cd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1406 microversion: 2.20 time: 0.152461 Sep 13 03:29:01.113468 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 397/826] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:29:00 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:29:02.135673 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:02.136392 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=10 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:02.140687 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-952aa178-884b-4e76-85ff-5bbc69e30554 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:02.141387 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-952aa178-884b-4e76-85ff-5bbc69e30554 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:02.148907 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-952aa178-884b-4e76-85ff-5bbc69e30554 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:02.149391 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-952aa178-884b-4e76-85ff-5bbc69e30554 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:02.149828 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-952aa178-884b-4e76-85ff-5bbc69e30554 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:02.150519 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-952aa178-884b-4e76-85ff-5bbc69e30554 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:02.151004 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-952aa178-884b-4e76-85ff-5bbc69e30554 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:02.151430 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-952aa178-884b-4e76-85ff-5bbc69e30554 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:02.278294 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-952aa178-884b-4e76-85ff-5bbc69e30554 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:02.286954 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-952aa178-884b-4e76-85ff-5bbc69e30554 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:02.288397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-952aa178-884b-4e76-85ff-5bbc69e30554 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:02.289503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-952aa178-884b-4e76-85ff-5bbc69e30554 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1406 microversion: 2.20 time: 0.155891 Sep 13 03:29:02.290330 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 430/827] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:29:02 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:29:02.958051 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0e6e3540-2e53-46a3-8463-9aa69139eeaa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:02.958570 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0e6e3540-2e53-46a3-8463-9aa69139eeaa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:02.960454 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:02.966033 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0e6e3540-2e53-46a3-8463-9aa69139eeaa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:02.966519 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0e6e3540-2e53-46a3-8463-9aa69139eeaa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:02.966995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0e6e3540-2e53-46a3-8463-9aa69139eeaa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:02.967680 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0e6e3540-2e53-46a3-8463-9aa69139eeaa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:02.968161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0e6e3540-2e53-46a3-8463-9aa69139eeaa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:02.968582 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0e6e3540-2e53-46a3-8463-9aa69139eeaa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:03.048368 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-0e6e3540-2e53-46a3-8463-9aa69139eeaa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lazy-loading 'services' on Instance uuid 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:29:03.122195 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0e6e3540-2e53-46a3-8463-9aa69139eeaa tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments/ffa8ce3e-d612-48e7-9087-3c413ea0028c" status: 202 len: 0 microversion: 2.1 time: 0.168720 Sep 13 03:29:03.122821 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 398/828] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 03:29:02 2022] DELETE /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments/ffa8ce3e-d612-48e7-9087-3c413ea0028c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:29:03.131805 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-343c4d79-d984-4043-b73a-b1eb6420009a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:03.134093 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-343c4d79-d984-4043-b73a-b1eb6420009a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:03.140712 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-343c4d79-d984-4043-b73a-b1eb6420009a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:03.141365 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-343c4d79-d984-4043-b73a-b1eb6420009a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:03.141642 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-343c4d79-d984-4043-b73a-b1eb6420009a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:03.142375 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-343c4d79-d984-4043-b73a-b1eb6420009a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:03.142884 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-343c4d79-d984-4043-b73a-b1eb6420009a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:03.143313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-343c4d79-d984-4043-b73a-b1eb6420009a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:03.173452 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-343c4d79-d984-4043-b73a-b1eb6420009a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046195 Sep 13 03:29:03.174002 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 431/829] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:29:03 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:29:03.313895 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-eaff5786-86fc-41c3-84e9-482e91adb3ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:03.314590 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-eaff5786-86fc-41c3-84e9-482e91adb3ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:03.321339 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-eaff5786-86fc-41c3-84e9-482e91adb3ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:03.321828 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-eaff5786-86fc-41c3-84e9-482e91adb3ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:03.322273 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-eaff5786-86fc-41c3-84e9-482e91adb3ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:03.323006 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-eaff5786-86fc-41c3-84e9-482e91adb3ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:03.323463 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-eaff5786-86fc-41c3-84e9-482e91adb3ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:03.323889 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-eaff5786-86fc-41c3-84e9-482e91adb3ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:03.451504 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-eaff5786-86fc-41c3-84e9-482e91adb3ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:03.460361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-eaff5786-86fc-41c3-84e9-482e91adb3ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:03.462042 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-eaff5786-86fc-41c3-84e9-482e91adb3ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:03.463274 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-eaff5786-86fc-41c3-84e9-482e91adb3ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1597 microversion: 2.20 time: 0.153712 Sep 13 03:29:03.463835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 399/830] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:29:03 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1597 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:29:03.487794 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-45443a14-7fe1-4839-8956-55ae2d172c2c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:03.488961 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-45443a14-7fe1-4839-8956-55ae2d172c2c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:03.494775 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-45443a14-7fe1-4839-8956-55ae2d172c2c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:03.495255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-45443a14-7fe1-4839-8956-55ae2d172c2c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:03.495682 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-45443a14-7fe1-4839-8956-55ae2d172c2c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:03.496355 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-45443a14-7fe1-4839-8956-55ae2d172c2c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:03.496806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-45443a14-7fe1-4839-8956-55ae2d172c2c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:03.497223 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-45443a14-7fe1-4839-8956-55ae2d172c2c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:03.577304 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-45443a14-7fe1-4839-8956-55ae2d172c2c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093294 Sep 13 03:29:03.577896 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 432/831] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Sep 13 03:29:03 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:29:04.186782 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9496d636-af2c-469f-a766-90ebd0ac07ec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:04.189027 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9496d636-af2c-469f-a766-90ebd0ac07ec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:04.196060 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9496d636-af2c-469f-a766-90ebd0ac07ec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:04.196549 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9496d636-af2c-469f-a766-90ebd0ac07ec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:04.196985 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9496d636-af2c-469f-a766-90ebd0ac07ec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:04.197674 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9496d636-af2c-469f-a766-90ebd0ac07ec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:04.198123 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9496d636-af2c-469f-a766-90ebd0ac07ec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:04.198540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9496d636-af2c-469f-a766-90ebd0ac07ec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:04.228037 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9496d636-af2c-469f-a766-90ebd0ac07ec tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045260 Sep 13 03:29:04.228597 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 400/832] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:29:04 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:29:04.505720 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-e5010fcf-31c5-456d-bc2d-d363ac57bd03 req-aa6c44b0-61c3-4b01-aba0-51bc459449b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a712d2c4-a489-45e8-941a-13abba66403c", "tag": "1b4bf2a7-2e87-4a14-894c-d018f847fb5b"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:04.514985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-e5010fcf-31c5-456d-bc2d-d363ac57bd03 req-aa6c44b0-61c3-4b01-aba0-51bc459449b5 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:04.515470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-e5010fcf-31c5-456d-bc2d-d363ac57bd03 req-aa6c44b0-61c3-4b01-aba0-51bc459449b5 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:04.515916 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-e5010fcf-31c5-456d-bc2d-d363ac57bd03 req-aa6c44b0-61c3-4b01-aba0-51bc459449b5 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:04.529067 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-e5010fcf-31c5-456d-bc2d-d363ac57bd03 req-aa6c44b0-61c3-4b01-aba0-51bc459449b5 service nova] Creating event network-changed:1b4bf2a7-2e87-4a14-894c-d018f847fb5b for instance a712d2c4-a489-45e8-941a-13abba66403c on hv-cinder-85707 Sep 13 03:29:04.534032 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-e5010fcf-31c5-456d-bc2d-d363ac57bd03 req-aa6c44b0-61c3-4b01-aba0-51bc459449b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033117 Sep 13 03:29:04.534637 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 433/833] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:29:05.240942 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8362e852-bb95-4500-a707-b2be6f6d2581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:05.244044 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8362e852-bb95-4500-a707-b2be6f6d2581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:05.251706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8362e852-bb95-4500-a707-b2be6f6d2581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:05.251706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8362e852-bb95-4500-a707-b2be6f6d2581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:05.252128 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8362e852-bb95-4500-a707-b2be6f6d2581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:05.253109 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8362e852-bb95-4500-a707-b2be6f6d2581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:05.254328 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8362e852-bb95-4500-a707-b2be6f6d2581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:05.255197 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8362e852-bb95-4500-a707-b2be6f6d2581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:05.288621 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8362e852-bb95-4500-a707-b2be6f6d2581 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051959 Sep 13 03:29:05.290044 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 401/834] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:29:05 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:29:06.179794 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8aa65b0f-0fb8-4ae4-9160-d23a4746b102 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:06.182018 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8aa65b0f-0fb8-4ae4-9160-d23a4746b102 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:06.188509 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8aa65b0f-0fb8-4ae4-9160-d23a4746b102 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:06.188989 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8aa65b0f-0fb8-4ae4-9160-d23a4746b102 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:06.189417 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8aa65b0f-0fb8-4ae4-9160-d23a4746b102 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:06.190097 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8aa65b0f-0fb8-4ae4-9160-d23a4746b102 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:06.190552 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8aa65b0f-0fb8-4ae4-9160-d23a4746b102 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:06.191027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8aa65b0f-0fb8-4ae4-9160-d23a4746b102 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:06.219159 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8aa65b0f-0fb8-4ae4-9160-d23a4746b102 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044091 Sep 13 03:29:06.219878 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 434/835] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:29:06 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 03:29:06.280889 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0b5ab43e-3593-4af8-a4c6-dd004a8dd131 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:06.281501 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0b5ab43e-3593-4af8-a4c6-dd004a8dd131 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:06.288971 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0b5ab43e-3593-4af8-a4c6-dd004a8dd131 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:06.289490 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0b5ab43e-3593-4af8-a4c6-dd004a8dd131 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:06.290185 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0b5ab43e-3593-4af8-a4c6-dd004a8dd131 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:06.290913 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0b5ab43e-3593-4af8-a4c6-dd004a8dd131 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:06.291373 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0b5ab43e-3593-4af8-a4c6-dd004a8dd131 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:06.291801 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0b5ab43e-3593-4af8-a4c6-dd004a8dd131 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:06.301955 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-bb7f938f-216d-47d5-ae65-2f37e19bfb5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:06.304174 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-bb7f938f-216d-47d5-ae65-2f37e19bfb5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:06.310029 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bb7f938f-216d-47d5-ae65-2f37e19bfb5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:06.310562 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bb7f938f-216d-47d5-ae65-2f37e19bfb5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:06.310996 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bb7f938f-216d-47d5-ae65-2f37e19bfb5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:06.311736 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bb7f938f-216d-47d5-ae65-2f37e19bfb5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:06.312193 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bb7f938f-216d-47d5-ae65-2f37e19bfb5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:06.312661 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bb7f938f-216d-47d5-ae65-2f37e19bfb5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:06.318178 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0b5ab43e-3593-4af8-a4c6-dd004a8dd131 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:29:06.341170 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-bb7f938f-216d-47d5-ae65-2f37e19bfb5a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043587 Sep 13 03:29:06.341860 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 435/836] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:29:06 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 03:29:06.392886 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0b5ab43e-3593-4af8-a4c6-dd004a8dd131 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 204 len: 0 microversion: 2.1 time: 0.115732 Sep 13 03:29:06.393793 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 402/837] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:29:06 2022] DELETE /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:29:06.401826 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-54a32de0-bfcb-410a-8e0d-01e85141ac6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:06.402800 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-54a32de0-bfcb-410a-8e0d-01e85141ac6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:06.409837 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54a32de0-bfcb-410a-8e0d-01e85141ac6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:06.411507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54a32de0-bfcb-410a-8e0d-01e85141ac6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:06.412069 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54a32de0-bfcb-410a-8e0d-01e85141ac6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:06.412886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54a32de0-bfcb-410a-8e0d-01e85141ac6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:06.413632 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54a32de0-bfcb-410a-8e0d-01e85141ac6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:06.414301 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54a32de0-bfcb-410a-8e0d-01e85141ac6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:06.422213 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d6d3c792-c2c1-4d74-a615-55104b808d1f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:06.422819 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d6d3c792-c2c1-4d74-a615-55104b808d1f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:06.429214 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6d3c792-c2c1-4d74-a615-55104b808d1f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:06.429703 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6d3c792-c2c1-4d74-a615-55104b808d1f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:06.430137 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6d3c792-c2c1-4d74-a615-55104b808d1f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:06.430865 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6d3c792-c2c1-4d74-a615-55104b808d1f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:06.431318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6d3c792-c2c1-4d74-a615-55104b808d1f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:06.431741 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d6d3c792-c2c1-4d74-a615-55104b808d1f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:06.456608 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d6d3c792-c2c1-4d74-a615-55104b808d1f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:29:06.532704 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d6d3c792-c2c1-4d74-a615-55104b808d1f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 204 len: 0 microversion: 2.1 time: 0.114387 Sep 13 03:29:06.536898 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 403/838] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:29:06 2022] DELETE /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:29:06.542936 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-08a452c2-641e-4f65-a33c-90be5bba0ceb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:06.543633 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-08a452c2-641e-4f65-a33c-90be5bba0ceb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:06.549841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-08a452c2-641e-4f65-a33c-90be5bba0ceb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:06.550387 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-08a452c2-641e-4f65-a33c-90be5bba0ceb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:06.551471 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-08a452c2-641e-4f65-a33c-90be5bba0ceb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:06.552185 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-08a452c2-641e-4f65-a33c-90be5bba0ceb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:06.552679 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-08a452c2-641e-4f65-a33c-90be5bba0ceb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:06.553107 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-08a452c2-641e-4f65-a33c-90be5bba0ceb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:06.554300 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-54a32de0-bfcb-410a-8e0d-01e85141ac6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:06.561903 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-54a32de0-bfcb-410a-8e0d-01e85141ac6f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1673 microversion: 2.1 time: 0.164095 Sep 13 03:29:06.562466 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 436/839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:06 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:06.684155 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-08a452c2-641e-4f65-a33c-90be5bba0ceb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:06.691869 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-08a452c2-641e-4f65-a33c-90be5bba0ceb tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1690 microversion: 2.1 time: 0.153631 Sep 13 03:29:06.692442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 404/840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:06 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:07.585645 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b9e08fe2-1c88-41eb-b284-8738315c925f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:07.586258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b9e08fe2-1c88-41eb-b284-8738315c925f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:07.589680 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:07.593792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b9e08fe2-1c88-41eb-b284-8738315c925f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:07.594269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b9e08fe2-1c88-41eb-b284-8738315c925f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:07.594733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b9e08fe2-1c88-41eb-b284-8738315c925f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:07.595410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b9e08fe2-1c88-41eb-b284-8738315c925f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:07.595863 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b9e08fe2-1c88-41eb-b284-8738315c925f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:07.596277 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b9e08fe2-1c88-41eb-b284-8738315c925f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:07.715171 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4cdabb58-92c4-44f1-8fda-6f8e647cdb2f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:07.715774 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-4cdabb58-92c4-44f1-8fda-6f8e647cdb2f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:07.722002 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4cdabb58-92c4-44f1-8fda-6f8e647cdb2f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:07.722489 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4cdabb58-92c4-44f1-8fda-6f8e647cdb2f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:07.722954 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4cdabb58-92c4-44f1-8fda-6f8e647cdb2f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:07.723638 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4cdabb58-92c4-44f1-8fda-6f8e647cdb2f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:07.724089 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4cdabb58-92c4-44f1-8fda-6f8e647cdb2f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:07.724507 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4cdabb58-92c4-44f1-8fda-6f8e647cdb2f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:07.725942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b9e08fe2-1c88-41eb-b284-8738315c925f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:07.733568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b9e08fe2-1c88-41eb-b284-8738315c925f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1673 microversion: 2.1 time: 0.151804 Sep 13 03:29:07.734120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 437/841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:07 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:07.855222 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4cdabb58-92c4-44f1-8fda-6f8e647cdb2f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:07.862849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4cdabb58-92c4-44f1-8fda-6f8e647cdb2f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1690 microversion: 2.1 time: 0.151489 Sep 13 03:29:07.863411 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 405/842] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:07 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:29:08.756936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-67d16775-b4db-45af-b9a0-2fc7addc47a0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:08.757545 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-67d16775-b4db-45af-b9a0-2fc7addc47a0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:08.763875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-67d16775-b4db-45af-b9a0-2fc7addc47a0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:08.764356 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-67d16775-b4db-45af-b9a0-2fc7addc47a0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:08.764788 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-67d16775-b4db-45af-b9a0-2fc7addc47a0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:08.765465 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-67d16775-b4db-45af-b9a0-2fc7addc47a0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:08.765916 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-67d16775-b4db-45af-b9a0-2fc7addc47a0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:08.766336 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-67d16775-b4db-45af-b9a0-2fc7addc47a0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:08.885664 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c75a57f7-d514-4604-af78-8f50c066e272 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:08.886271 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c75a57f7-d514-4604-af78-8f50c066e272 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:08.892582 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c75a57f7-d514-4604-af78-8f50c066e272 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:08.893067 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c75a57f7-d514-4604-af78-8f50c066e272 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:08.893501 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c75a57f7-d514-4604-af78-8f50c066e272 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:08.894189 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c75a57f7-d514-4604-af78-8f50c066e272 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:08.894659 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c75a57f7-d514-4604-af78-8f50c066e272 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:08.895081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c75a57f7-d514-4604-af78-8f50c066e272 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:08.896666 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-67d16775-b4db-45af-b9a0-2fc7addc47a0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:08.904597 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-67d16775-b4db-45af-b9a0-2fc7addc47a0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1673 microversion: 2.1 time: 0.151960 Sep 13 03:29:08.905366 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 438/843] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:08 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:09.025791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c75a57f7-d514-4604-af78-8f50c066e272 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:09.033291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c75a57f7-d514-4604-af78-8f50c066e272 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1690 microversion: 2.1 time: 0.151420 Sep 13 03:29:09.033856 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 406/844] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:08 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:29:09.927504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f8cfb709-e73a-4c4a-a4f2-b1549bcd62bb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:09.928114 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f8cfb709-e73a-4c4a-a4f2-b1549bcd62bb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:09.934499 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f8cfb709-e73a-4c4a-a4f2-b1549bcd62bb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:09.935012 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f8cfb709-e73a-4c4a-a4f2-b1549bcd62bb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:09.935451 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f8cfb709-e73a-4c4a-a4f2-b1549bcd62bb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:09.936137 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f8cfb709-e73a-4c4a-a4f2-b1549bcd62bb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:09.936595 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f8cfb709-e73a-4c4a-a4f2-b1549bcd62bb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:09.937018 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f8cfb709-e73a-4c4a-a4f2-b1549bcd62bb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:10.056237 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a52b56f2-6651-479f-b9b5-de1d5fc63071 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:10.056853 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a52b56f2-6651-479f-b9b5-de1d5fc63071 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:10.063330 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f8cfb709-e73a-4c4a-a4f2-b1549bcd62bb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:10.064921 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a52b56f2-6651-479f-b9b5-de1d5fc63071 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:10.065547 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a52b56f2-6651-479f-b9b5-de1d5fc63071 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:10.066013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a52b56f2-6651-479f-b9b5-de1d5fc63071 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:10.066758 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a52b56f2-6651-479f-b9b5-de1d5fc63071 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:10.067223 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a52b56f2-6651-479f-b9b5-de1d5fc63071 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:10.068324 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a52b56f2-6651-479f-b9b5-de1d5fc63071 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:10.071865 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f8cfb709-e73a-4c4a-a4f2-b1549bcd62bb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1673 microversion: 2.1 time: 0.148183 Sep 13 03:29:10.072767 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 439/845] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:09 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:10.196480 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a52b56f2-6651-479f-b9b5-de1d5fc63071 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:10.204009 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a52b56f2-6651-479f-b9b5-de1d5fc63071 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1690 microversion: 2.1 time: 0.151701 Sep 13 03:29:10.204648 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 407/846] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:10 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:29:11.095456 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ec6ee42c-ad5f-4ad0-8259-de3f6c182dcb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:11.096067 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ec6ee42c-ad5f-4ad0-8259-de3f6c182dcb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:11.102414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ec6ee42c-ad5f-4ad0-8259-de3f6c182dcb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:11.102939 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ec6ee42c-ad5f-4ad0-8259-de3f6c182dcb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:11.103380 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ec6ee42c-ad5f-4ad0-8259-de3f6c182dcb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:11.104068 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ec6ee42c-ad5f-4ad0-8259-de3f6c182dcb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:11.104525 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ec6ee42c-ad5f-4ad0-8259-de3f6c182dcb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:11.104949 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ec6ee42c-ad5f-4ad0-8259-de3f6c182dcb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:11.227401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6c6ab107-d699-4a7a-b3f8-17bf602bea4a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:11.228040 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6c6ab107-d699-4a7a-b3f8-17bf602bea4a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:11.230514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:11.232554 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ec6ee42c-ad5f-4ad0-8259-de3f6c182dcb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:11.235774 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6c6ab107-d699-4a7a-b3f8-17bf602bea4a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:11.236267 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6c6ab107-d699-4a7a-b3f8-17bf602bea4a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:11.236706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6c6ab107-d699-4a7a-b3f8-17bf602bea4a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:11.237411 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6c6ab107-d699-4a7a-b3f8-17bf602bea4a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:11.237866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6c6ab107-d699-4a7a-b3f8-17bf602bea4a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:11.238293 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6c6ab107-d699-4a7a-b3f8-17bf602bea4a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:11.241161 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ec6ee42c-ad5f-4ad0-8259-de3f6c182dcb tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1673 microversion: 2.1 time: 0.149557 Sep 13 03:29:11.241731 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 440/847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:11 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:11.374248 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-6c6ab107-d699-4a7a-b3f8-17bf602bea4a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:11.377657 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:11.383011 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6c6ab107-d699-4a7a-b3f8-17bf602bea4a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1690 microversion: 2.1 time: 0.159459 Sep 13 03:29:11.383582 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 408/848] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:11 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:29:12.264790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-31e6ea38-594d-4bf1-a337-116e35320f79 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:12.266048 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-31e6ea38-594d-4bf1-a337-116e35320f79 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:12.272766 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-31e6ea38-594d-4bf1-a337-116e35320f79 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:12.273253 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-31e6ea38-594d-4bf1-a337-116e35320f79 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:12.273745 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-31e6ea38-594d-4bf1-a337-116e35320f79 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:12.274440 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-31e6ea38-594d-4bf1-a337-116e35320f79 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:12.274919 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-31e6ea38-594d-4bf1-a337-116e35320f79 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:12.275805 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-31e6ea38-594d-4bf1-a337-116e35320f79 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:12.382242 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-31e6ea38-594d-4bf1-a337-116e35320f79 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:12.390123 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-31e6ea38-594d-4bf1-a337-116e35320f79 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1605 microversion: 2.1 time: 0.129164 Sep 13 03:29:12.402799 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 441/849] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:12 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1605 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:12.407302 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-fdb010b2-028c-4845-8a69-e2487cfac235 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:12.407933 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-fdb010b2-028c-4845-8a69-e2487cfac235 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:12.415871 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fdb010b2-028c-4845-8a69-e2487cfac235 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:12.416359 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fdb010b2-028c-4845-8a69-e2487cfac235 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:12.416790 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fdb010b2-028c-4845-8a69-e2487cfac235 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:12.417480 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fdb010b2-028c-4845-8a69-e2487cfac235 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:12.418507 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fdb010b2-028c-4845-8a69-e2487cfac235 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:12.418958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fdb010b2-028c-4845-8a69-e2487cfac235 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:12.546926 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-fdb010b2-028c-4845-8a69-e2487cfac235 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:12.555367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-fdb010b2-028c-4845-8a69-e2487cfac235 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1690 microversion: 2.1 time: 0.152963 Sep 13 03:29:12.555935 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 409/850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:12 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:13.056118 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-2cc3b47f-8bd3-4e15-9f8d-fea3a9c0d067 req-dc1a2372-6862-4486-aa43-fe330f7a8fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81", "name": "network-vif-deleted", "tag": "5e1eb65a-db49-4f23-a402-182f179922bc"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:13.065631 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2cc3b47f-8bd3-4e15-9f8d-fea3a9c0d067 req-dc1a2372-6862-4486-aa43-fe330f7a8fb6 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:13.066127 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2cc3b47f-8bd3-4e15-9f8d-fea3a9c0d067 req-dc1a2372-6862-4486-aa43-fe330f7a8fb6 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:13.066772 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2cc3b47f-8bd3-4e15-9f8d-fea3a9c0d067 req-dc1a2372-6862-4486-aa43-fe330f7a8fb6 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:13.080212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-2cc3b47f-8bd3-4e15-9f8d-fea3a9c0d067 req-dc1a2372-6862-4486-aa43-fe330f7a8fb6 service nova] Creating event network-vif-deleted:5e1eb65a-db49-4f23-a402-182f179922bc for instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 on hv-cinder-85707 Sep 13 03:29:13.085837 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-2cc3b47f-8bd3-4e15-9f8d-fea3a9c0d067 req-dc1a2372-6862-4486-aa43-fe330f7a8fb6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033361 Sep 13 03:29:13.096750 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 442/851] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:29:13.413880 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:13.414496 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:13.425179 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:13.425863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:13.426406 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:13.427789 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:13.428353 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:13.428943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:13.468404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:13.468900 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:13.469408 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:13.469867 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lazy-loading 'fault' on Instance uuid c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:29:13.526986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:13.535350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f1806722-142b-4582-8a8a-e63665be872d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 200 len: 1327 microversion: 2.1 time: 0.125842 Sep 13 03:29:13.536845 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 410/852] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:13 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:13.579040 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:13.580326 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:13.590253 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:13.591240 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:13.591864 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:13.592741 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:13.593593 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:13.594180 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:13.632058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:13.632734 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:13.633327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:13.633942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lazy-loading 'fault' on Instance uuid 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:29:13.685494 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:13.693366 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4b5fa1f7-58ae-48d6-9488-197fb14c91ba tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1336 microversion: 2.1 time: 0.118728 Sep 13 03:29:13.708447 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 443/853] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:13 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1336 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:14.563241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-205a28fe-988d-4088-9a76-eff05559cf7e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:14.563849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-205a28fe-988d-4088-9a76-eff05559cf7e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:14.571651 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-205a28fe-988d-4088-9a76-eff05559cf7e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:14.572151 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-205a28fe-988d-4088-9a76-eff05559cf7e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:14.572595 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-205a28fe-988d-4088-9a76-eff05559cf7e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:14.573300 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-205a28fe-988d-4088-9a76-eff05559cf7e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:14.573757 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-205a28fe-988d-4088-9a76-eff05559cf7e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:14.574181 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-205a28fe-988d-4088-9a76-eff05559cf7e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:14.587495 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-205a28fe-988d-4088-9a76-eff05559cf7e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] HTTP exception thrown: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-205a28fe-988d-4088-9a76-eff05559cf7e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Request method failure captured: Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 HTTP/1.1 Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_ccI8efIaRUA7ZVgB8Wgcwh_Bnp3zd1kXsary1kbD4u1sq1N4vdeZ4v_lvf04xAN98kEHQ2wAwnh31KTOBQAz2HyGUsJdq6DCie2mDoqB7SCms5cOk0Xf5u5jVcKjKBLoAjWHYHknJfwywjR80qK_6Jre0rEZvvkQpt9RLlxAFifP0 Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: bb8f67ac0f3c48b2933b6ae34d4fd838 Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:29:14.589068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:29:14.590717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bb8f67ac0f3c48b2933b6ae34d4fd838", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}] Sep 13 03:29:14.590717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:29:14.590717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: bb8f67ac0f3c48b2933b6ae34d4fd838 Sep 13 03:29:14.590717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:29:14.590717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeTestJSON-373766804-project Sep 13 03:29:14.590717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:29:14.590717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:29:14.590717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 80f6f9a952d84ccab0de028d58aa6914 Sep 13 03:29:14.590717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeTestJSON-373766804-project Sep 13 03:29:14.590717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:29:14.590717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:29:14.590717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': 'c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81'} Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:29:14.591637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:29:14.592996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:29:14.594197 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-205a28fe-988d-4088-9a76-eff05559cf7e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Returning 404 to user: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:29:14.594197 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-205a28fe-988d-4088-9a76-eff05559cf7e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 404 len: 111 microversion: 2.1 time: 0.031237 Sep 13 03:29:14.594197 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 411/854] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:14 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:29:14.600069 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-569ff638-f238-4640-b8cf-ee090fe44a59 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '.version_select at 0x7f89356e1f70>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:14.626934 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-569ff638-f238-4640-b8cf-ee090fe44a59 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-922426083" status: 202 len: 0 microversion: 2.1 time: 0.031081 Sep 13 03:29:14.627752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 444/855] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Sep 13 03:29:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-922426083 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:29:14.722465 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:14.723352 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:14.732689 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:14.733829 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:14.734343 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:14.735136 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:14.735599 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:14.736028 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:14.781155 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:14.782509 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:14.783677 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:14.784322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lazy-loading 'fault' on Instance uuid 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:29:14.845954 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:14.854103 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3f0d6c72-3a86-4474-bac2-a3f0860c479f tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 200 len: 1336 microversion: 2.1 time: 0.136669 Sep 13 03:29:14.854692 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 412/856] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:14 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 1336 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:15.121685 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-7ed22d7d-20b2-478d-9090-c249a5056848 req-0ad8bec5-a79a-40df-aba3-080087155d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f", "name": "network-vif-deleted", "tag": "7cf9530c-a7c2-4a93-8567-f2298a93d7de"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:15.131522 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-7ed22d7d-20b2-478d-9090-c249a5056848 req-0ad8bec5-a79a-40df-aba3-080087155d4c service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:15.131999 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-7ed22d7d-20b2-478d-9090-c249a5056848 req-0ad8bec5-a79a-40df-aba3-080087155d4c service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:15.132426 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-7ed22d7d-20b2-478d-9090-c249a5056848 req-0ad8bec5-a79a-40df-aba3-080087155d4c service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:15.142430 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-7ed22d7d-20b2-478d-9090-c249a5056848 req-0ad8bec5-a79a-40df-aba3-080087155d4c service nova] Creating event network-vif-deleted:7cf9530c-a7c2-4a93-8567-f2298a93d7de for instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f on hv-cinder-85707 Sep 13 03:29:15.147791 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-7ed22d7d-20b2-478d-9090-c249a5056848 req-0ad8bec5-a79a-40df-aba3-080087155d4c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029799 Sep 13 03:29:15.148377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 445/857] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:29:15.300547 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a8e9b244-9c74-4564-b907-b65c6f26eb87 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Action: 'create', calling method: .version_select at 0x7f89356a2790>, body: {"keypair": {"name": "tempest-keypair-56091141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq6oWRWGeqcDfAK7Jw2UBIYhIpRzqnehuGL/8rYCVRCPWkHphT1FfGrnk2/ophq1GrksmmoSlSfS8ygLn7ux6q9MzpTxMv7DeGGz3tEna33lHL5lOJuCSqzTR95ZFHfDg=="}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:15.315388 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-a8e9b244-9c74-4564-b907-b65c6f26eb87 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Getting quotas for project bb8f67ac0f3c48b2933b6ae34d4fd838. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:29:15.319651 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-a8e9b244-9c74-4564-b907-b65c6f26eb87 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Getting quotas for user 80f6f9a952d84ccab0de028d58aa6914 and project bb8f67ac0f3c48b2933b6ae34d4fd838. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:29:15.331489 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a8e9b244-9c74-4564-b907-b65c6f26eb87 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [2e9b1171-7b28-4ac0-8ef2-ab75311ab940] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 03:29:15.878503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-564b4c69-8256-4c85-ab04-c4b2c04f7b9b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:15.879238 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-564b4c69-8256-4c85-ab04-c4b2c04f7b9b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:15.885877 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-564b4c69-8256-4c85-ab04-c4b2c04f7b9b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:15.886358 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-564b4c69-8256-4c85-ab04-c4b2c04f7b9b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:15.886827 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-564b4c69-8256-4c85-ab04-c4b2c04f7b9b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:15.887518 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-564b4c69-8256-4c85-ab04-c4b2c04f7b9b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:15.887975 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-564b4c69-8256-4c85-ab04-c4b2c04f7b9b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:15.888397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-564b4c69-8256-4c85-ab04-c4b2c04f7b9b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:15.901279 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-564b4c69-8256-4c85-ab04-c4b2c04f7b9b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] HTTP exception thrown: Instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f could not be found. Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-564b4c69-8256-4c85-ab04-c4b2c04f7b9b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Request method failure captured: Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f HTTP/1.1 Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_ckfyr_FdMe7JDHHYQ02j3Yi-uV_C-rB4-EtATCIFXSBWLGGhu9M98PVZJquzMru2LcuccQVe7G9t8nFYxTH3gfXeSgkIQO_KMYHzhIs9bP_Y8CpAoG2B5UzUZ2HsrVN9VQy5PjeEaRinTvDlcb_cFRPIRwhk4q_eTKwpu_yzwcs8M Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 609f8dcac1034d09a04192f4238b2857 Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:29:15.902901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:29:15.904504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/609f8dcac1034d09a04192f4238b2857"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_609f8dcac1034d09a04192f4238b2857", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/609f8dcac1034d09a04192f4238b2857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/609f8dcac1034d09a04192f4238b2857"}]}] Sep 13 03:29:15.904504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:29:15.904504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 609f8dcac1034d09a04192f4238b2857 Sep 13 03:29:15.904504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:29:15.904504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-ServerRescueNegativeTestJSON-1628822356-project Sep 13 03:29:15.904504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:29:15.904504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:29:15.904504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: b85258f01e1f436585eb6b9a4f3813b8 Sep 13 03:29:15.904504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1628822356-project Sep 13 03:29:15.904504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:29:15.904504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f could not be found. Sep 13 03:29:15.904504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': '3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f'} Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f could not be found. Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:29:15.905629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f could not be found. Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f could not be found. Sep 13 03:29:15.907122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:15.908785 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-564b4c69-8256-4c85-ab04-c4b2c04f7b9b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Returning 404 to user: Instance 3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:29:15.908785 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-564b4c69-8256-4c85-ab04-c4b2c04f7b9b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f" status: 404 len: 111 microversion: 2.1 time: 0.030415 Sep 13 03:29:15.908785 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 446/858] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:15 2022] GET /compute/v2.1/servers/3ad3017b-24b7-40ec-9e2f-cafb07f3bd1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 03:29:15.912211 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b568b92e-05b5-416f-ba4a-b18fbb4ca016 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '.version_select at 0x7f89356e1dc0>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:15.930684 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b568b92e-05b5-416f-ba4a-b18fbb4ca016 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199906739" status: 202 len: 0 microversion: 2.1 time: 0.021775 Sep 13 03:29:15.931243 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 447/859] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Sep 13 03:29:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199906739 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 03:29:16.338673 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO oslo.messaging._drivers.impl_rabbit [None req-a8e9b244-9c74-4564-b907-b65c6f26eb87 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [2e9b1171-7b28-4ac0-8ef2-ab75311ab940] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52462. Sep 13 03:29:16.353453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a8e9b244-9c74-4564-b907-b65c6f26eb87 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.056876 Sep 13 03:29:16.354219 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 413/860] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 03:29:15 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:29:17.619369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-988629583", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56b0350b-2f1d-46ac-ad32-a74946bfd610"}], "security_groups": [{"name": "tempest-securitygroup--1887031801"}], "key_name": "tempest-keypair-56091141", "user_data": "}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:17.727654 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.network.neutron [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] validate_networks() for [('56b0350b-2f1d-46ac-ad32-a74946bfd610', None, None, None, None, None)] {{(pid=120383) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:29:18.103546 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Flavor limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:29:18.103992 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Image limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:29:18.104459 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Flavor pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:29:18.104860 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Image pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:29:18.105310 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:29:18.115076 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:18.115590 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:18.116041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:18.116776 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:18.117229 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:18.117651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:18.134960 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Getting quotas for project bb8f67ac0f3c48b2933b6ae34d4fd838. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:29:18.138825 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Getting quotas for user 80f6f9a952d84ccab0de028d58aa6914 and project bb8f67ac0f3c48b2933b6ae34d4fd838. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:29:18.149914 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Going to run 1 instances... {{(pid=120383) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:29:18.152202 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:29:18.201507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7874afd5-a753-4eed-ae30-42150ea22242 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.587528 Sep 13 03:29:18.202162 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 448/861] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:29:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 03:29:18.214472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-bb170d67-463a-4e74-938e-43324086ff0b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:18.215031 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-bb170d67-463a-4e74-938e-43324086ff0b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:18.273487 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-bb170d67-463a-4e74-938e-43324086ff0b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:18.281126 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-bb170d67-463a-4e74-938e-43324086ff0b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1235 microversion: 2.1 time: 0.071073 Sep 13 03:29:18.281685 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 414/862] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:18 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1235 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:18.799774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d450a4a4-87f2-4edd-9ebd-f713b3b8b52a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:18.800324 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d450a4a4-87f2-4edd-9ebd-f713b3b8b52a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:18.807548 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d450a4a4-87f2-4edd-9ebd-f713b3b8b52a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:18.808041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d450a4a4-87f2-4edd-9ebd-f713b3b8b52a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:18.808483 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d450a4a4-87f2-4edd-9ebd-f713b3b8b52a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:18.809179 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d450a4a4-87f2-4edd-9ebd-f713b3b8b52a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:18.809648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d450a4a4-87f2-4edd-9ebd-f713b3b8b52a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:18.810077 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d450a4a4-87f2-4edd-9ebd-f713b3b8b52a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:18.836485 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d450a4a4-87f2-4edd-9ebd-f713b3b8b52a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Going to try to terminate instance {{(pid=120383) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:29:18.914255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d450a4a4-87f2-4edd-9ebd-f713b3b8b52a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 204 len: 0 microversion: 2.1 time: 0.118258 Sep 13 03:29:18.915289 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 449/863] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:29:18 2022] DELETE /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:29:18.923722 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0fe9818c-8472-41db-9a9a-13fb59978f3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:18.924360 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0fe9818c-8472-41db-9a9a-13fb59978f3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:18.931237 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0fe9818c-8472-41db-9a9a-13fb59978f3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:18.931726 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0fe9818c-8472-41db-9a9a-13fb59978f3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:18.932164 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0fe9818c-8472-41db-9a9a-13fb59978f3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:18.932850 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0fe9818c-8472-41db-9a9a-13fb59978f3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:18.933300 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0fe9818c-8472-41db-9a9a-13fb59978f3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:18.933719 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0fe9818c-8472-41db-9a9a-13fb59978f3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:19.063355 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0fe9818c-8472-41db-9a9a-13fb59978f3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:19.071574 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0fe9818c-8472-41db-9a9a-13fb59978f3b tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1509 microversion: 2.1 time: 0.151821 Sep 13 03:29:19.072496 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 415/864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:18 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:19.304934 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ede1098b-7f50-4591-8cc2-eb92f9384cd2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:19.305660 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ede1098b-7f50-4591-8cc2-eb92f9384cd2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:19.311569 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ede1098b-7f50-4591-8cc2-eb92f9384cd2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:19.311988 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ede1098b-7f50-4591-8cc2-eb92f9384cd2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:19.312420 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ede1098b-7f50-4591-8cc2-eb92f9384cd2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:19.313100 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ede1098b-7f50-4591-8cc2-eb92f9384cd2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:19.313548 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ede1098b-7f50-4591-8cc2-eb92f9384cd2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:19.313964 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ede1098b-7f50-4591-8cc2-eb92f9384cd2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:19.318348 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:19.379208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ede1098b-7f50-4591-8cc2-eb92f9384cd2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:19.387199 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ede1098b-7f50-4591-8cc2-eb92f9384cd2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1287 microversion: 2.1 time: 0.086373 Sep 13 03:29:19.387757 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 450/865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:19 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:20.096759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f7c1ea84-ecbd-4a24-a374-659de1d68d86 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:20.097967 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f7c1ea84-ecbd-4a24-a374-659de1d68d86 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:20.104721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7c1ea84-ecbd-4a24-a374-659de1d68d86 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:20.105617 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7c1ea84-ecbd-4a24-a374-659de1d68d86 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:20.106082 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7c1ea84-ecbd-4a24-a374-659de1d68d86 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:20.107975 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7c1ea84-ecbd-4a24-a374-659de1d68d86 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:20.108494 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7c1ea84-ecbd-4a24-a374-659de1d68d86 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:20.108928 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f7c1ea84-ecbd-4a24-a374-659de1d68d86 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:20.249579 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f7c1ea84-ecbd-4a24-a374-659de1d68d86 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:20.257920 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f7c1ea84-ecbd-4a24-a374-659de1d68d86 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1509 microversion: 2.1 time: 0.165152 Sep 13 03:29:20.258482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 416/866] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:20 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:20.410342 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a69fae91-4af4-4891-8588-11c2fdf0c671 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:20.411010 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a69fae91-4af4-4891-8588-11c2fdf0c671 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:20.417846 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a69fae91-4af4-4891-8588-11c2fdf0c671 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:20.418340 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a69fae91-4af4-4891-8588-11c2fdf0c671 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:20.418811 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a69fae91-4af4-4891-8588-11c2fdf0c671 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:20.419516 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a69fae91-4af4-4891-8588-11c2fdf0c671 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:20.420006 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a69fae91-4af4-4891-8588-11c2fdf0c671 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:20.420387 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a69fae91-4af4-4891-8588-11c2fdf0c671 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:20.532350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a69fae91-4af4-4891-8588-11c2fdf0c671 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:20.540206 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a69fae91-4af4-4891-8588-11c2fdf0c671 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1293 microversion: 2.1 time: 0.133429 Sep 13 03:29:20.540770 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 451/867] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:20 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1293 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:20.842186 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-d60dd618-b573-4a45-bf4d-9213889446b6 req-f2eb7342-e9c1-47ab-ae6c-7567521dc2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0445581f-c40d-4838-864c-bb080dcf594b", "name": "network-vif-deleted", "tag": "f18a4265-4277-4b61-a45f-eca4e86395c8"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:20.856856 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-d60dd618-b573-4a45-bf4d-9213889446b6 req-f2eb7342-e9c1-47ab-ae6c-7567521dc2e9 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:20.857448 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-d60dd618-b573-4a45-bf4d-9213889446b6 req-f2eb7342-e9c1-47ab-ae6c-7567521dc2e9 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:20.858092 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-d60dd618-b573-4a45-bf4d-9213889446b6 req-f2eb7342-e9c1-47ab-ae6c-7567521dc2e9 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:20.870968 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-d60dd618-b573-4a45-bf4d-9213889446b6 req-f2eb7342-e9c1-47ab-ae6c-7567521dc2e9 service nova] Creating event network-vif-deleted:f18a4265-4277-4b61-a45f-eca4e86395c8 for instance 0445581f-c40d-4838-864c-bb080dcf594b on hv-cinder-85707 Sep 13 03:29:20.876642 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-d60dd618-b573-4a45-bf4d-9213889446b6 req-f2eb7342-e9c1-47ab-ae6c-7567521dc2e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040768 Sep 13 03:29:20.877910 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 417/868] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:29:21.282409 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:21.283167 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:21.296353 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:21.296881 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:21.297310 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:21.298541 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:21.299219 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:21.299644 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:21.333450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:21.334011 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:21.334528 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:21.335149 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lazy-loading 'fault' on Instance uuid 0445581f-c40d-4838-864c-bb080dcf594b {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:29:21.386435 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:21.396281 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b762d5a7-f9c0-4b84-8d0a-252517d54199 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 200 len: 1312 microversion: 2.1 time: 0.117033 Sep 13 03:29:21.396855 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 452/869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:21 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 1312 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:21.565033 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c45c9654-de7e-41e3-8e33-c023dacce275 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:21.565647 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c45c9654-de7e-41e3-8e33-c023dacce275 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:21.572279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c45c9654-de7e-41e3-8e33-c023dacce275 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:21.572771 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c45c9654-de7e-41e3-8e33-c023dacce275 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:21.573211 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c45c9654-de7e-41e3-8e33-c023dacce275 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:21.573901 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c45c9654-de7e-41e3-8e33-c023dacce275 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:21.574359 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c45c9654-de7e-41e3-8e33-c023dacce275 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:21.574816 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c45c9654-de7e-41e3-8e33-c023dacce275 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:21.716812 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c45c9654-de7e-41e3-8e33-c023dacce275 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:21.730577 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c45c9654-de7e-41e3-8e33-c023dacce275 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1361 microversion: 2.1 time: 0.170375 Sep 13 03:29:21.731187 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 418/870] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:21 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:22.419337 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e8852275-83db-4387-a549-feeb35cc85d6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:22.420121 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e8852275-83db-4387-a549-feeb35cc85d6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 0445581f-c40d-4838-864c-bb080dcf594b] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:22.427399 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e8852275-83db-4387-a549-feeb35cc85d6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:22.427889 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e8852275-83db-4387-a549-feeb35cc85d6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:22.428323 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e8852275-83db-4387-a549-feeb35cc85d6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:22.429012 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e8852275-83db-4387-a549-feeb35cc85d6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:22.429474 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e8852275-83db-4387-a549-feeb35cc85d6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:22.429897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e8852275-83db-4387-a549-feeb35cc85d6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:22.443224 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-e8852275-83db-4387-a549-feeb35cc85d6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] HTTP exception thrown: Instance 0445581f-c40d-4838-864c-bb080dcf594b could not be found. Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e8852275-83db-4387-a549-feeb35cc85d6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Request method failure captured: Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b HTTP/1.1 Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_ckfyr_FdMe7JDHHYQ02j3Yi-uV_C-rB4-EtATCIFXSBWLGGhu9M98PVZJquzMru2LcuccQVe7G9t8nFYxTH3gfXeSgkIQO_KMYHzhIs9bP_Y8CpAoG2B5UzUZ2HsrVN9VQy5PjeEaRinTvDlcb_cFRPIRwhk4q_eTKwpu_yzwcs8M Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 609f8dcac1034d09a04192f4238b2857 Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:29:22.444868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:29:22.446482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/609f8dcac1034d09a04192f4238b2857"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_609f8dcac1034d09a04192f4238b2857", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/609f8dcac1034d09a04192f4238b2857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/609f8dcac1034d09a04192f4238b2857"}]}] Sep 13 03:29:22.446482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:29:22.446482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 609f8dcac1034d09a04192f4238b2857 Sep 13 03:29:22.446482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:29:22.446482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-ServerRescueNegativeTestJSON-1628822356-project Sep 13 03:29:22.446482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:29:22.446482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:29:22.446482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: b85258f01e1f436585eb6b9a4f3813b8 Sep 13 03:29:22.446482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1628822356-project Sep 13 03:29:22.446482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:29:22.446482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance 0445581f-c40d-4838-864c-bb080dcf594b could not be found. Sep 13 03:29:22.446482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': '0445581f-c40d-4838-864c-bb080dcf594b'} Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0445581f-c40d-4838-864c-bb080dcf594b could not be found. Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:29:22.447400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0445581f-c40d-4838-864c-bb080dcf594b could not be found. Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0445581f-c40d-4838-864c-bb080dcf594b could not be found. Sep 13 03:29:22.448898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:22.450483 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e8852275-83db-4387-a549-feeb35cc85d6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Returning 404 to user: Instance 0445581f-c40d-4838-864c-bb080dcf594b could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:29:22.450483 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e8852275-83db-4387-a549-feeb35cc85d6 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b" status: 404 len: 111 microversion: 2.1 time: 0.031270 Sep 13 03:29:22.450483 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 453/871] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:22 2022] GET /compute/v2.1/servers/0445581f-c40d-4838-864c-bb080dcf594b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:29:22.454940 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3334a3c0-a324-4521-9387-002cda962b8a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:22.455440 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3334a3c0-a324-4521-9387-002cda962b8a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:22.461970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3334a3c0-a324-4521-9387-002cda962b8a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:22.462488 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3334a3c0-a324-4521-9387-002cda962b8a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:22.462992 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3334a3c0-a324-4521-9387-002cda962b8a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:22.463688 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3334a3c0-a324-4521-9387-002cda962b8a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:22.464149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3334a3c0-a324-4521-9387-002cda962b8a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:22.464606 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3334a3c0-a324-4521-9387-002cda962b8a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:22.489355 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3334a3c0-a324-4521-9387-002cda962b8a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:29:22.561117 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3334a3c0-a324-4521-9387-002cda962b8a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "DELETE /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 204 len: 0 microversion: 2.1 time: 0.110063 Sep 13 03:29:22.561697 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 419/872] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:29:22 2022] DELETE /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:29:22.569593 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1df3547e-2424-40bf-9837-2d2f5591c3b8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:22.570206 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1df3547e-2424-40bf-9837-2d2f5591c3b8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:22.576097 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1df3547e-2424-40bf-9837-2d2f5591c3b8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:22.576583 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1df3547e-2424-40bf-9837-2d2f5591c3b8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:22.577021 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1df3547e-2424-40bf-9837-2d2f5591c3b8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:22.577702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1df3547e-2424-40bf-9837-2d2f5591c3b8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:22.578157 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1df3547e-2424-40bf-9837-2d2f5591c3b8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:22.578578 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1df3547e-2424-40bf-9837-2d2f5591c3b8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:22.710550 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1df3547e-2424-40bf-9837-2d2f5591c3b8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:22.718137 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1df3547e-2424-40bf-9837-2d2f5591c3b8 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.152336 Sep 13 03:29:22.718717 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 454/873] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:22 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:22.755253 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ca2126c1-adf7-4386-b5da-ab2d621fef96 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:22.755958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ca2126c1-adf7-4386-b5da-ab2d621fef96 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:22.762213 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ca2126c1-adf7-4386-b5da-ab2d621fef96 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:22.762745 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ca2126c1-adf7-4386-b5da-ab2d621fef96 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:22.763183 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ca2126c1-adf7-4386-b5da-ab2d621fef96 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:22.763876 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ca2126c1-adf7-4386-b5da-ab2d621fef96 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:22.764334 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ca2126c1-adf7-4386-b5da-ab2d621fef96 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:22.764760 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ca2126c1-adf7-4386-b5da-ab2d621fef96 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:22.893688 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-a60cb323-6f79-4c1a-ae22-01f5f69d5db8 req-786293ff-f598-46e1-9116-4dc0e64b3149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67827f2d-1e40-4e54-83b5-906368c76022", "tag": "3cf8c0a3-568d-455a-8ea4-b062a263d4f1"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:22.903551 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ca2126c1-adf7-4386-b5da-ab2d621fef96 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:22.904642 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-a60cb323-6f79-4c1a-ae22-01f5f69d5db8 req-786293ff-f598-46e1-9116-4dc0e64b3149 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:22.905366 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-a60cb323-6f79-4c1a-ae22-01f5f69d5db8 req-786293ff-f598-46e1-9116-4dc0e64b3149 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:22.906033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-a60cb323-6f79-4c1a-ae22-01f5f69d5db8 req-786293ff-f598-46e1-9116-4dc0e64b3149 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:22.913687 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ca2126c1-adf7-4386-b5da-ab2d621fef96 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1361 microversion: 2.1 time: 0.162579 Sep 13 03:29:22.914205 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 420/874] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:22 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:22.918683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-a60cb323-6f79-4c1a-ae22-01f5f69d5db8 req-786293ff-f598-46e1-9116-4dc0e64b3149 service nova] Creating event network-changed:3cf8c0a3-568d-455a-8ea4-b062a263d4f1 for instance 67827f2d-1e40-4e54-83b5-906368c76022 on hv-cinder-85707 Sep 13 03:29:22.924101 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-a60cb323-6f79-4c1a-ae22-01f5f69d5db8 req-786293ff-f598-46e1-9116-4dc0e64b3149 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034681 Sep 13 03:29:22.926331 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 455/875] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:29:23.741734 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6204e948-6f06-4b9b-9b31-664b1d214085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:23.742350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6204e948-6f06-4b9b-9b31-664b1d214085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:23.748343 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6204e948-6f06-4b9b-9b31-664b1d214085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:23.748827 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6204e948-6f06-4b9b-9b31-664b1d214085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:23.749263 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6204e948-6f06-4b9b-9b31-664b1d214085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:23.749948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6204e948-6f06-4b9b-9b31-664b1d214085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:23.750406 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6204e948-6f06-4b9b-9b31-664b1d214085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:23.750860 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6204e948-6f06-4b9b-9b31-664b1d214085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:23.876754 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-6204e948-6f06-4b9b-9b31-664b1d214085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:23.884401 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6204e948-6f06-4b9b-9b31-664b1d214085 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.147243 Sep 13 03:29:23.884959 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 421/876] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:23 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:23.936626 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cf802e93-f7c6-4bec-b462-5e13ed4bf566 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:23.937326 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-cf802e93-f7c6-4bec-b462-5e13ed4bf566 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:23.944121 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf802e93-f7c6-4bec-b462-5e13ed4bf566 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:23.944595 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf802e93-f7c6-4bec-b462-5e13ed4bf566 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:23.945026 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf802e93-f7c6-4bec-b462-5e13ed4bf566 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:23.945705 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf802e93-f7c6-4bec-b462-5e13ed4bf566 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:23.946154 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf802e93-f7c6-4bec-b462-5e13ed4bf566 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:23.946574 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cf802e93-f7c6-4bec-b462-5e13ed4bf566 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:24.076365 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-cf802e93-f7c6-4bec-b462-5e13ed4bf566 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:24.084392 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-cf802e93-f7c6-4bec-b462-5e13ed4bf566 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1361 microversion: 2.1 time: 0.151853 Sep 13 03:29:24.084954 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 456/877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:23 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:24.906718 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f2bbf20b-2888-4d68-a741-94764d9021ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:24.907338 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f2bbf20b-2888-4d68-a741-94764d9021ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:24.914404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f2bbf20b-2888-4d68-a741-94764d9021ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:24.915189 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f2bbf20b-2888-4d68-a741-94764d9021ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:24.915628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f2bbf20b-2888-4d68-a741-94764d9021ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:24.916318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f2bbf20b-2888-4d68-a741-94764d9021ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:24.916777 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f2bbf20b-2888-4d68-a741-94764d9021ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:24.917205 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f2bbf20b-2888-4d68-a741-94764d9021ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:25.044862 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f2bbf20b-2888-4d68-a741-94764d9021ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:25.052410 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f2bbf20b-2888-4d68-a741-94764d9021ff tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.149595 Sep 13 03:29:25.052972 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 422/878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:24 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:25.108294 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ade8fadb-4828-4544-95ee-ec67a2ffc1bf tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:25.108930 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ade8fadb-4828-4544-95ee-ec67a2ffc1bf tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:25.114837 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ade8fadb-4828-4544-95ee-ec67a2ffc1bf tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:25.115317 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ade8fadb-4828-4544-95ee-ec67a2ffc1bf tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:25.115751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ade8fadb-4828-4544-95ee-ec67a2ffc1bf tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:25.116429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ade8fadb-4828-4544-95ee-ec67a2ffc1bf tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:25.116880 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ade8fadb-4828-4544-95ee-ec67a2ffc1bf tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:25.117326 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ade8fadb-4828-4544-95ee-ec67a2ffc1bf tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:25.276037 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ade8fadb-4828-4544-95ee-ec67a2ffc1bf tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:25.283497 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ade8fadb-4828-4544-95ee-ec67a2ffc1bf tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1361 microversion: 2.1 time: 0.180161 Sep 13 03:29:25.284067 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 457/879] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:25 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:26.075660 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a75e9d9c-314d-4441-ab7f-fa1357ce874a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:26.076270 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a75e9d9c-314d-4441-ab7f-fa1357ce874a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:26.082683 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a75e9d9c-314d-4441-ab7f-fa1357ce874a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:26.083169 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a75e9d9c-314d-4441-ab7f-fa1357ce874a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:26.083599 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a75e9d9c-314d-4441-ab7f-fa1357ce874a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:26.084272 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a75e9d9c-314d-4441-ab7f-fa1357ce874a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:26.084750 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a75e9d9c-314d-4441-ab7f-fa1357ce874a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:26.085166 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a75e9d9c-314d-4441-ab7f-fa1357ce874a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:26.218291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a75e9d9c-314d-4441-ab7f-fa1357ce874a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:26.226494 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a75e9d9c-314d-4441-ab7f-fa1357ce874a tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1523 microversion: 2.1 time: 0.154771 Sep 13 03:29:26.227088 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 423/880] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:26 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:26.305538 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c20d55ea-47bc-44bb-af7a-285202dbd2a9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:26.306173 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c20d55ea-47bc-44bb-af7a-285202dbd2a9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:26.313075 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c20d55ea-47bc-44bb-af7a-285202dbd2a9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:26.313644 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c20d55ea-47bc-44bb-af7a-285202dbd2a9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:26.314412 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c20d55ea-47bc-44bb-af7a-285202dbd2a9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:26.315213 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c20d55ea-47bc-44bb-af7a-285202dbd2a9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:26.315752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c20d55ea-47bc-44bb-af7a-285202dbd2a9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:26.316260 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c20d55ea-47bc-44bb-af7a-285202dbd2a9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:26.528536 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c20d55ea-47bc-44bb-af7a-285202dbd2a9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:26.536742 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c20d55ea-47bc-44bb-af7a-285202dbd2a9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1361 microversion: 2.1 time: 0.234534 Sep 13 03:29:26.537312 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 458/881] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:26 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:27.109375 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-9d78f70b-a5a4-41ae-9824-e4e48d41c71a req-2b9960b6-8cc6-4411-b1ac-271fa530e521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722dd938-0b13-46d0-9fa1-ff945702438c", "name": "network-vif-deleted", "tag": "3183447b-b590-4633-92e3-7d4198ae1660"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:27.125276 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-9d78f70b-a5a4-41ae-9824-e4e48d41c71a req-2b9960b6-8cc6-4411-b1ac-271fa530e521 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:27.125761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-9d78f70b-a5a4-41ae-9824-e4e48d41c71a req-2b9960b6-8cc6-4411-b1ac-271fa530e521 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:27.126395 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-9d78f70b-a5a4-41ae-9824-e4e48d41c71a req-2b9960b6-8cc6-4411-b1ac-271fa530e521 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:27.139983 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-9d78f70b-a5a4-41ae-9824-e4e48d41c71a req-2b9960b6-8cc6-4411-b1ac-271fa530e521 service nova] Creating event network-vif-deleted:3183447b-b590-4633-92e3-7d4198ae1660 for instance 722dd938-0b13-46d0-9fa1-ff945702438c on hv-cinder-85707 Sep 13 03:29:27.145413 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-9d78f70b-a5a4-41ae-9824-e4e48d41c71a req-2b9960b6-8cc6-4411-b1ac-271fa530e521 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042150 Sep 13 03:29:27.146327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 424/882] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:29:27.249257 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:27.249879 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:27.256489 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:27.256971 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:27.257405 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:27.258087 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:27.258541 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:27.258988 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:27.289010 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:27.289819 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:27.290188 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:27.290724 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lazy-loading 'fault' on Instance uuid 722dd938-0b13-46d0-9fa1-ff945702438c {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:29:27.332988 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85258f01e1f436585eb6b9a4f3813b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609f8dcac1034d09a04192f4238b2857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:27.340905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ea5f6c86-db1e-4aee-9692-45be07dcc9dd tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 200 len: 1312 microversion: 2.1 time: 0.095464 Sep 13 03:29:27.341630 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 459/883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:27 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:27.560073 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f9872c8e-57df-43a0-bdb3-2cd596b14ff4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:27.560763 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f9872c8e-57df-43a0-bdb3-2cd596b14ff4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:27.566998 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f9872c8e-57df-43a0-bdb3-2cd596b14ff4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:27.567490 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f9872c8e-57df-43a0-bdb3-2cd596b14ff4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:27.567979 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f9872c8e-57df-43a0-bdb3-2cd596b14ff4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:27.568664 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f9872c8e-57df-43a0-bdb3-2cd596b14ff4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:27.569113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f9872c8e-57df-43a0-bdb3-2cd596b14ff4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:27.569532 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f9872c8e-57df-43a0-bdb3-2cd596b14ff4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:27.697854 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f9872c8e-57df-43a0-bdb3-2cd596b14ff4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:27.705324 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f9872c8e-57df-43a0-bdb3-2cd596b14ff4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1361 microversion: 2.1 time: 0.149392 Sep 13 03:29:27.705883 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 425/884] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:27 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:28.365026 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c47307af-921d-4e16-8b32-e8ae6d354a26 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:28.365789 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c47307af-921d-4e16-8b32-e8ae6d354a26 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] [instance: 722dd938-0b13-46d0-9fa1-ff945702438c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:28.368843 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:28.369551 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=6 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:28.374730 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c47307af-921d-4e16-8b32-e8ae6d354a26 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:28.375297 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c47307af-921d-4e16-8b32-e8ae6d354a26 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:28.375805 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c47307af-921d-4e16-8b32-e8ae6d354a26 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:28.376571 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c47307af-921d-4e16-8b32-e8ae6d354a26 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:28.377123 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c47307af-921d-4e16-8b32-e8ae6d354a26 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:28.377558 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c47307af-921d-4e16-8b32-e8ae6d354a26 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:28.392244 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-c47307af-921d-4e16-8b32-e8ae6d354a26 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] HTTP exception thrown: Instance 722dd938-0b13-46d0-9fa1-ff945702438c could not be found. Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c47307af-921d-4e16-8b32-e8ae6d354a26 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Request method failure captured: Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c HTTP/1.1 Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_ckfyr_FdMe7JDHHYQ02j3Yi-uV_C-rB4-EtATCIFXSBWLGGhu9M98PVZJquzMru2LcuccQVe7G9t8nFYxTH3gfXeSgkIQO_KMYHzhIs9bP_Y8CpAoG2B5UzUZ2HsrVN9VQy5PjeEaRinTvDlcb_cFRPIRwhk4q_eTKwpu_yzwcs8M Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 609f8dcac1034d09a04192f4238b2857 Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:29:28.393897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:29:28.395702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/609f8dcac1034d09a04192f4238b2857"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_609f8dcac1034d09a04192f4238b2857", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/609f8dcac1034d09a04192f4238b2857"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/609f8dcac1034d09a04192f4238b2857"}]}] Sep 13 03:29:28.395702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:29:28.395702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 609f8dcac1034d09a04192f4238b2857 Sep 13 03:29:28.395702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1628822356 Sep 13 03:29:28.395702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-ServerRescueNegativeTestJSON-1628822356-project Sep 13 03:29:28.395702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:29:28.395702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:29:28.395702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: b85258f01e1f436585eb6b9a4f3813b8 Sep 13 03:29:28.395702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1628822356-project Sep 13 03:29:28.395702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:29:28.395702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance 722dd938-0b13-46d0-9fa1-ff945702438c could not be found. Sep 13 03:29:28.395702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': '722dd938-0b13-46d0-9fa1-ff945702438c'} Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 722dd938-0b13-46d0-9fa1-ff945702438c could not be found. Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:29:28.397302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 722dd938-0b13-46d0-9fa1-ff945702438c could not be found. Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 722dd938-0b13-46d0-9fa1-ff945702438c could not be found. Sep 13 03:29:28.398601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:29:28.400023 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c47307af-921d-4e16-8b32-e8ae6d354a26 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] Returning 404 to user: Instance 722dd938-0b13-46d0-9fa1-ff945702438c could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:29:28.400023 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c47307af-921d-4e16-8b32-e8ae6d354a26 tempest-ServerRescueNegativeTestJSON-1628822356 tempest-ServerRescueNegativeTestJSON-1628822356-project] 10.222.0.18 "GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c" status: 404 len: 111 microversion: 2.1 time: 0.034716 Sep 13 03:29:28.400023 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 460/885] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:28 2022] GET /compute/v2.1/servers/722dd938-0b13-46d0-9fa1-ff945702438c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:29:28.422914 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-f3f5ebda-fdad-4677-93d9-d9505ed331c4 req-bfb66ddb-a4fc-4aa8-aa04-0a3118f10103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67827f2d-1e40-4e54-83b5-906368c76022", "name": "network-vif-plugged", "status": "completed", "tag": "3cf8c0a3-568d-455a-8ea4-b062a263d4f1"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:28.430143 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=6 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:28.435567 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-f3f5ebda-fdad-4677-93d9-d9505ed331c4 req-bfb66ddb-a4fc-4aa8-aa04-0a3118f10103 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:28.435846 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-f3f5ebda-fdad-4677-93d9-d9505ed331c4 req-bfb66ddb-a4fc-4aa8-aa04-0a3118f10103 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:28.436302 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-f3f5ebda-fdad-4677-93d9-d9505ed331c4 req-bfb66ddb-a4fc-4aa8-aa04-0a3118f10103 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:28.449066 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-f3f5ebda-fdad-4677-93d9-d9505ed331c4 req-bfb66ddb-a4fc-4aa8-aa04-0a3118f10103 service nova] Creating event network-vif-plugged:3cf8c0a3-568d-455a-8ea4-b062a263d4f1 for instance 67827f2d-1e40-4e54-83b5-906368c76022 on hv-cinder-85707 Sep 13 03:29:28.453870 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-f3f5ebda-fdad-4677-93d9-d9505ed331c4 req-bfb66ddb-a4fc-4aa8-aa04-0a3118f10103 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034922 Sep 13 03:29:28.454663 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 426/886] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:29:28.727609 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-06314199-cf3f-4880-b81f-51370676da00 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:28.728230 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-06314199-cf3f-4880-b81f-51370676da00 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:28.734102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06314199-cf3f-4880-b81f-51370676da00 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:28.734593 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06314199-cf3f-4880-b81f-51370676da00 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:28.735072 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06314199-cf3f-4880-b81f-51370676da00 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:28.735767 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06314199-cf3f-4880-b81f-51370676da00 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:28.736227 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06314199-cf3f-4880-b81f-51370676da00 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:28.736656 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-06314199-cf3f-4880-b81f-51370676da00 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:28.960975 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-06314199-cf3f-4880-b81f-51370676da00 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:28.968571 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-06314199-cf3f-4880-b81f-51370676da00 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1361 microversion: 2.1 time: 0.244823 Sep 13 03:29:28.969172 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 461/887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:28 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:29.993953 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-17481a63-c03a-4140-afe8-a878d99e6a6c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:29.994711 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-17481a63-c03a-4140-afe8-a878d99e6a6c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:30.001335 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17481a63-c03a-4140-afe8-a878d99e6a6c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:30.002076 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17481a63-c03a-4140-afe8-a878d99e6a6c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:30.003224 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17481a63-c03a-4140-afe8-a878d99e6a6c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:30.005032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17481a63-c03a-4140-afe8-a878d99e6a6c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:30.005980 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17481a63-c03a-4140-afe8-a878d99e6a6c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:30.006420 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-17481a63-c03a-4140-afe8-a878d99e6a6c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:30.227442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-17481a63-c03a-4140-afe8-a878d99e6a6c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:30.231004 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:30.236274 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-17481a63-c03a-4140-afe8-a878d99e6a6c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1361 microversion: 2.1 time: 0.247733 Sep 13 03:29:30.236850 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 427/888] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:29 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:31.260122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-690a9628-43ea-4fc4-afb0-84368a6e22b0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:31.260675 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-690a9628-43ea-4fc4-afb0-84368a6e22b0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:31.267301 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-690a9628-43ea-4fc4-afb0-84368a6e22b0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:31.267792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-690a9628-43ea-4fc4-afb0-84368a6e22b0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:31.268233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-690a9628-43ea-4fc4-afb0-84368a6e22b0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:31.268931 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-690a9628-43ea-4fc4-afb0-84368a6e22b0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:31.269399 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-690a9628-43ea-4fc4-afb0-84368a6e22b0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:31.269828 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-690a9628-43ea-4fc4-afb0-84368a6e22b0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:31.425453 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-690a9628-43ea-4fc4-afb0-84368a6e22b0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:31.435102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-690a9628-43ea-4fc4-afb0-84368a6e22b0 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1547 microversion: 2.1 time: 0.178914 Sep 13 03:29:31.436000 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 462/889] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:31 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:31.461985 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3bd29162-7aad-49f6-8cbc-80bb74f48a1f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:31.462652 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3bd29162-7aad-49f6-8cbc-80bb74f48a1f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:31.471334 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3bd29162-7aad-49f6-8cbc-80bb74f48a1f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:31.472222 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3bd29162-7aad-49f6-8cbc-80bb74f48a1f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:31.472833 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3bd29162-7aad-49f6-8cbc-80bb74f48a1f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:31.473836 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3bd29162-7aad-49f6-8cbc-80bb74f48a1f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:31.474660 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3bd29162-7aad-49f6-8cbc-80bb74f48a1f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:31.475252 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3bd29162-7aad-49f6-8cbc-80bb74f48a1f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:31.610689 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3bd29162-7aad-49f6-8cbc-80bb74f48a1f tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154107 Sep 13 03:29:31.611862 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 428/890] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 03:29:31 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:29:32.861778 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-376fc72e-b0e8-445c-bb0f-6c9339329905 req-67d96520-f276-421a-9caf-019250e45f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67827f2d-1e40-4e54-83b5-906368c76022", "tag": "3cf8c0a3-568d-455a-8ea4-b062a263d4f1"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:32.871870 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-376fc72e-b0e8-445c-bb0f-6c9339329905 req-67d96520-f276-421a-9caf-019250e45f41 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:32.872691 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-376fc72e-b0e8-445c-bb0f-6c9339329905 req-67d96520-f276-421a-9caf-019250e45f41 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:32.873313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-376fc72e-b0e8-445c-bb0f-6c9339329905 req-67d96520-f276-421a-9caf-019250e45f41 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:32.885150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-376fc72e-b0e8-445c-bb0f-6c9339329905 req-67d96520-f276-421a-9caf-019250e45f41 service nova] Creating event network-changed:3cf8c0a3-568d-455a-8ea4-b062a263d4f1 for instance 67827f2d-1e40-4e54-83b5-906368c76022 on hv-cinder-85707 Sep 13 03:29:32.891148 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-376fc72e-b0e8-445c-bb0f-6c9339329905 req-67d96520-f276-421a-9caf-019250e45f41 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032881 Sep 13 03:29:32.891930 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 463/891] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:29:35.244008 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ab331c57-4af9-4f2a-b059-fb4a828bbd5f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:35.244738 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ab331c57-4af9-4f2a-b059-fb4a828bbd5f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:35.251973 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab331c57-4af9-4f2a-b059-fb4a828bbd5f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:35.252431 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab331c57-4af9-4f2a-b059-fb4a828bbd5f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:35.252957 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab331c57-4af9-4f2a-b059-fb4a828bbd5f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:35.253853 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab331c57-4af9-4f2a-b059-fb4a828bbd5f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:35.254368 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab331c57-4af9-4f2a-b059-fb4a828bbd5f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:35.254781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab331c57-4af9-4f2a-b059-fb4a828bbd5f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:35.280409 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ab331c57-4af9-4f2a-b059-fb4a828bbd5f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:29:35.375796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ab331c57-4af9-4f2a-b059-fb4a828bbd5f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 204 len: 0 microversion: 2.1 time: 0.135528 Sep 13 03:29:35.378688 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 429/892] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:29:35 2022] DELETE /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:29:35.386425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-277d48ef-4fc8-42a4-b814-50e2f5cc493c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:35.387708 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-277d48ef-4fc8-42a4-b814-50e2f5cc493c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:35.393730 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-277d48ef-4fc8-42a4-b814-50e2f5cc493c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:35.394207 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-277d48ef-4fc8-42a4-b814-50e2f5cc493c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:35.394652 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-277d48ef-4fc8-42a4-b814-50e2f5cc493c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:35.396054 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-277d48ef-4fc8-42a4-b814-50e2f5cc493c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:35.396509 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-277d48ef-4fc8-42a4-b814-50e2f5cc493c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:35.396928 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-277d48ef-4fc8-42a4-b814-50e2f5cc493c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:35.545175 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-277d48ef-4fc8-42a4-b814-50e2f5cc493c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:35.553571 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-277d48ef-4fc8-42a4-b814-50e2f5cc493c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1576 microversion: 2.1 time: 0.171832 Sep 13 03:29:35.554152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 464/893] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:35 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:36.577569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ab0e36f8-eaff-4a7a-aff7-3150152679f3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:36.578213 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ab0e36f8-eaff-4a7a-aff7-3150152679f3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:36.584483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab0e36f8-eaff-4a7a-aff7-3150152679f3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:36.584975 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab0e36f8-eaff-4a7a-aff7-3150152679f3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:36.585415 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab0e36f8-eaff-4a7a-aff7-3150152679f3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:36.586111 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab0e36f8-eaff-4a7a-aff7-3150152679f3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:36.586568 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab0e36f8-eaff-4a7a-aff7-3150152679f3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:36.587020 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ab0e36f8-eaff-4a7a-aff7-3150152679f3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:36.721010 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ab0e36f8-eaff-4a7a-aff7-3150152679f3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:36.729881 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ab0e36f8-eaff-4a7a-aff7-3150152679f3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1576 microversion: 2.1 time: 0.156482 Sep 13 03:29:36.730648 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 430/894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:36 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:37.752720 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2cdeaf30-1ef3-4291-ad46-954dad41f40c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:37.753346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2cdeaf30-1ef3-4291-ad46-954dad41f40c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:37.756371 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:37.762127 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2cdeaf30-1ef3-4291-ad46-954dad41f40c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:37.762638 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2cdeaf30-1ef3-4291-ad46-954dad41f40c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:37.763075 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2cdeaf30-1ef3-4291-ad46-954dad41f40c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:37.763946 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2cdeaf30-1ef3-4291-ad46-954dad41f40c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:37.764679 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2cdeaf30-1ef3-4291-ad46-954dad41f40c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:37.765379 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2cdeaf30-1ef3-4291-ad46-954dad41f40c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:37.970756 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2cdeaf30-1ef3-4291-ad46-954dad41f40c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:37.980315 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2cdeaf30-1ef3-4291-ad46-954dad41f40c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1576 microversion: 2.1 time: 0.231397 Sep 13 03:29:37.981703 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 465/895] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:37 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1576 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:29:38.338784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-da0cbad6-24f0-4e33-871b-72224a05eaaf req-976d0277-e3ff-4362-bf39-23f75790a967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4319ab9-e7a2-45ea-ae43-c9860ed33cef", "name": "network-vif-deleted", "tag": "b5169432-a539-41f3-a735-e6f12d3f1fbc"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:38.350147 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-da0cbad6-24f0-4e33-871b-72224a05eaaf req-976d0277-e3ff-4362-bf39-23f75790a967 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:38.350647 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-da0cbad6-24f0-4e33-871b-72224a05eaaf req-976d0277-e3ff-4362-bf39-23f75790a967 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:38.351282 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-da0cbad6-24f0-4e33-871b-72224a05eaaf req-976d0277-e3ff-4362-bf39-23f75790a967 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:38.368693 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-da0cbad6-24f0-4e33-871b-72224a05eaaf req-976d0277-e3ff-4362-bf39-23f75790a967 service nova] Creating event network-vif-deleted:b5169432-a539-41f3-a735-e6f12d3f1fbc for instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef on hv-cinder-85707 Sep 13 03:29:38.397836 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-da0cbad6-24f0-4e33-871b-72224a05eaaf req-976d0277-e3ff-4362-bf39-23f75790a967 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062424 Sep 13 03:29:38.398450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 431/896] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:29:39.009886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:39.011150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:39.018513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:39.019221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:39.019827 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:39.020851 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:39.021456 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:39.022029 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:39.057086 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:39.057573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:39.062773 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:39.062773 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lazy-loading 'fault' on Instance uuid b4319ab9-e7a2-45ea-ae43-c9860ed33cef {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:29:39.102451 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:39.111473 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b775d1d2-d10e-4826-93e6-4e448a6a2435 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 200 len: 1230 microversion: 2.1 time: 0.105418 Sep 13 03:29:39.112368 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 466/897] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:39 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:40.136373 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-69990680-4e67-42be-86a4-30415dfe41e1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:40.136888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-69990680-4e67-42be-86a4-30415dfe41e1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:40.143042 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-69990680-4e67-42be-86a4-30415dfe41e1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:40.143529 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-69990680-4e67-42be-86a4-30415dfe41e1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:40.143969 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-69990680-4e67-42be-86a4-30415dfe41e1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:40.144662 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-69990680-4e67-42be-86a4-30415dfe41e1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:40.145121 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-69990680-4e67-42be-86a4-30415dfe41e1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:40.146117 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-69990680-4e67-42be-86a4-30415dfe41e1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:40.159616 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-69990680-4e67-42be-86a4-30415dfe41e1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] HTTP exception thrown: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-69990680-4e67-42be-86a4-30415dfe41e1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Request method failure captured: Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef HTTP/1.1 Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_hDpEhAK4darfXwyYbk_uq8BYyVeujtIvO_YriX6f8mOb-iEWBo4kPVBm36oim4Z6uU64Mka6geIXfi1Y7R7QtU_MRuTpkXWu2xsvlIvcQZiQx6sS_bG5FdNG46X3D46zCMKcNPvb_itPTyDQcQ3ODos5jE-1ey9zFPuqBF8IW2K4s Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: ab6c92ba81254caaad368fd0ef382b0e Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:29:40.161304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:29:40.162981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab6c92ba81254caaad368fd0ef382b0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab6c92ba81254caaad368fd0ef382b0e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab6c92ba81254caaad368fd0ef382b0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab6c92ba81254caaad368fd0ef382b0e"}]}] Sep 13 03:29:40.162981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:29:40.162981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: ab6c92ba81254caaad368fd0ef382b0e Sep 13 03:29:40.162981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:29:40.162981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-TestVolumeBootPattern-1706251283-project Sep 13 03:29:40.162981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:29:40.162981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:29:40.162981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 47fa1f7ce54145ceb3564b9ba7b4964f Sep 13 03:29:40.162981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-TestVolumeBootPattern-1706251283-project Sep 13 03:29:40.162981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:29:40.162981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:29:40.162981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': 'b4319ab9-e7a2-45ea-ae43-c9860ed33cef'} Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:29:40.164001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:29:40.165795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:29:40.167195 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-69990680-4e67-42be-86a4-30415dfe41e1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Returning 404 to user: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:29:40.167195 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-69990680-4e67-42be-86a4-30415dfe41e1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 404 len: 111 microversion: 2.1 time: 0.031325 Sep 13 03:29:40.167195 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 432/898] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:40 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:29:40.266991 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1071367904", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-196387094", "security_groups": [{"name": "tempest-secgroup-smoke-2028642222"}], "block_device_mapping_v2": [{"uuid": "0357ddbe-3aa4-461a-acc4-22333d924c4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "93f6860d-aa52-425f-a0b7-a39e9fc582c8"}]}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:40.396457 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.network.neutron [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] validate_networks() for [('93f6860d-aa52-425f-a0b7-a39e9fc582c8', None, None, None, None, None)] {{(pid=120383) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:29:40.774426 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Flavor limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:29:40.775249 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Image limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:29:40.776877 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Flavor pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:29:40.777561 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Image pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:29:40.778184 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:29:40.787814 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:40.788317 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:40.788755 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:40.789776 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:40.790236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:40.790691 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:40.808615 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Getting quotas for project ab6c92ba81254caaad368fd0ef382b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:29:40.812621 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Getting quotas for user 47fa1f7ce54145ceb3564b9ba7b4964f and project ab6c92ba81254caaad368fd0ef382b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:29:40.871002 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Going to run 1 instances... {{(pid=120383) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:29:40.873120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0357ddbe-3aa4-461a-acc4-22333d924c4e',volume_size=None,volume_type=None)] {{(pid=120383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:29:40.998266 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-734e04d8-2aad-4d1e-9930-9ebfeafb1bc3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.735549 Sep 13 03:29:40.998939 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 467/899] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:29:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:29:41.010550 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9e93e578-069b-4a83-96cd-decbe8e008cd tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:41.011186 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9e93e578-069b-4a83-96cd-decbe8e008cd tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:41.066736 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9e93e578-069b-4a83-96cd-decbe8e008cd tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:41.074369 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9e93e578-069b-4a83-96cd-decbe8e008cd tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1094 microversion: 2.1 time: 0.067620 Sep 13 03:29:41.075051 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 433/900] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:41 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:42.099645 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-47278cf1-75e1-4e6c-85e3-ee923294ac7d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:42.100253 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-47278cf1-75e1-4e6c-85e3-ee923294ac7d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:42.106841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-47278cf1-75e1-4e6c-85e3-ee923294ac7d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:42.107556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-47278cf1-75e1-4e6c-85e3-ee923294ac7d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:42.108190 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-47278cf1-75e1-4e6c-85e3-ee923294ac7d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:42.108869 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-47278cf1-75e1-4e6c-85e3-ee923294ac7d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:42.109315 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-47278cf1-75e1-4e6c-85e3-ee923294ac7d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:42.109737 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-47278cf1-75e1-4e6c-85e3-ee923294ac7d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:42.185472 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-47278cf1-75e1-4e6c-85e3-ee923294ac7d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:42.193170 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-47278cf1-75e1-4e6c-85e3-ee923294ac7d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1200 microversion: 2.1 time: 0.098564 Sep 13 03:29:42.194096 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 468/901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:42 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1200 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:43.217015 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-73ab5bd1-1713-4166-8992-701ed67231e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:43.217745 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-73ab5bd1-1713-4166-8992-701ed67231e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:43.220415 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:43.227216 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-73ab5bd1-1713-4166-8992-701ed67231e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:43.227714 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-73ab5bd1-1713-4166-8992-701ed67231e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:43.228151 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-73ab5bd1-1713-4166-8992-701ed67231e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:43.228854 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-73ab5bd1-1713-4166-8992-701ed67231e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:43.229309 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-73ab5bd1-1713-4166-8992-701ed67231e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:43.229731 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-73ab5bd1-1713-4166-8992-701ed67231e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:43.363621 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-73ab5bd1-1713-4166-8992-701ed67231e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:43.371818 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-73ab5bd1-1713-4166-8992-701ed67231e0 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1278 microversion: 2.1 time: 0.158812 Sep 13 03:29:43.372379 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 434/902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:43 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:44.394072 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ad1f1401-4a5f-4785-b895-2fb443033169 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:44.394626 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ad1f1401-4a5f-4785-b895-2fb443033169 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:44.400988 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ad1f1401-4a5f-4785-b895-2fb443033169 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:44.401473 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ad1f1401-4a5f-4785-b895-2fb443033169 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:44.401930 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ad1f1401-4a5f-4785-b895-2fb443033169 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:44.402598 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ad1f1401-4a5f-4785-b895-2fb443033169 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:44.403076 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ad1f1401-4a5f-4785-b895-2fb443033169 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:44.403502 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ad1f1401-4a5f-4785-b895-2fb443033169 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:44.407429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:44.530163 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ad1f1401-4a5f-4785-b895-2fb443033169 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:44.537772 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ad1f1401-4a5f-4785-b895-2fb443033169 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1278 microversion: 2.1 time: 0.147627 Sep 13 03:29:44.538327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 469/903] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:44 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:45.362129 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-b65d30e6-fff6-45a7-a098-92bcafcee566 req-636cde0c-38bd-4d01-9bbd-91e09ee94b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47509aa-d316-494f-8446-a2f81a1f234c", "tag": "58cadb39-f080-4b49-bdc0-0bad103c6ae7"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:45.385149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-b65d30e6-fff6-45a7-a098-92bcafcee566 req-636cde0c-38bd-4d01-9bbd-91e09ee94b42 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:45.385629 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-b65d30e6-fff6-45a7-a098-92bcafcee566 req-636cde0c-38bd-4d01-9bbd-91e09ee94b42 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:45.386053 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-b65d30e6-fff6-45a7-a098-92bcafcee566 req-636cde0c-38bd-4d01-9bbd-91e09ee94b42 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:45.397251 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-b65d30e6-fff6-45a7-a098-92bcafcee566 req-636cde0c-38bd-4d01-9bbd-91e09ee94b42 service nova] Creating event network-changed:58cadb39-f080-4b49-bdc0-0bad103c6ae7 for instance e47509aa-d316-494f-8446-a2f81a1f234c on hv-cinder-85707 Sep 13 03:29:45.402090 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-b65d30e6-fff6-45a7-a098-92bcafcee566 req-636cde0c-38bd-4d01-9bbd-91e09ee94b42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043555 Sep 13 03:29:45.402701 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 435/904] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:29:45.560362 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cc0bed6b-d40a-4f3b-b405-2d9714c5f650 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:45.560970 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-cc0bed6b-d40a-4f3b-b405-2d9714c5f650 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:45.567346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cc0bed6b-d40a-4f3b-b405-2d9714c5f650 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:45.567828 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cc0bed6b-d40a-4f3b-b405-2d9714c5f650 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:45.568259 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cc0bed6b-d40a-4f3b-b405-2d9714c5f650 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:45.568941 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cc0bed6b-d40a-4f3b-b405-2d9714c5f650 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:45.569396 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cc0bed6b-d40a-4f3b-b405-2d9714c5f650 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:45.569818 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cc0bed6b-d40a-4f3b-b405-2d9714c5f650 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:45.701485 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-cc0bed6b-d40a-4f3b-b405-2d9714c5f650 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:45.709631 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-cc0bed6b-d40a-4f3b-b405-2d9714c5f650 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1278 microversion: 2.1 time: 0.153089 Sep 13 03:29:45.710187 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 470/905] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:45 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:46.732980 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-4958252f-929c-4aca-96a6-1c10cee93b4c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:46.733695 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-4958252f-929c-4aca-96a6-1c10cee93b4c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:46.740474 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4958252f-929c-4aca-96a6-1c10cee93b4c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:46.740955 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4958252f-929c-4aca-96a6-1c10cee93b4c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:46.741387 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4958252f-929c-4aca-96a6-1c10cee93b4c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:46.742071 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4958252f-929c-4aca-96a6-1c10cee93b4c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:46.742527 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4958252f-929c-4aca-96a6-1c10cee93b4c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:46.742973 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-4958252f-929c-4aca-96a6-1c10cee93b4c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:46.886544 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-4958252f-929c-4aca-96a6-1c10cee93b4c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:46.894184 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-4958252f-929c-4aca-96a6-1c10cee93b4c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1278 microversion: 2.1 time: 0.165997 Sep 13 03:29:46.903102 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 436/906] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:46 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:47.917428 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-db5f3a66-2e3e-47bd-8a6c-17f82b4142d8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:47.918070 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-db5f3a66-2e3e-47bd-8a6c-17f82b4142d8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:47.924545 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-db5f3a66-2e3e-47bd-8a6c-17f82b4142d8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:47.925034 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-db5f3a66-2e3e-47bd-8a6c-17f82b4142d8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:47.925469 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-db5f3a66-2e3e-47bd-8a6c-17f82b4142d8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:47.926154 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-db5f3a66-2e3e-47bd-8a6c-17f82b4142d8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:47.927224 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-db5f3a66-2e3e-47bd-8a6c-17f82b4142d8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:47.927650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-db5f3a66-2e3e-47bd-8a6c-17f82b4142d8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:48.069305 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-db5f3a66-2e3e-47bd-8a6c-17f82b4142d8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:48.077552 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-db5f3a66-2e3e-47bd-8a6c-17f82b4142d8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1266 microversion: 2.1 time: 0.164143 Sep 13 03:29:48.078120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 471/907] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:47 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:49.100203 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8c0d6dc6-31d0-4e36-a7f1-3a19c8edbe2b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:49.100816 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8c0d6dc6-31d0-4e36-a7f1-3a19c8edbe2b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:49.107082 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8c0d6dc6-31d0-4e36-a7f1-3a19c8edbe2b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:49.107566 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8c0d6dc6-31d0-4e36-a7f1-3a19c8edbe2b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:49.107999 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8c0d6dc6-31d0-4e36-a7f1-3a19c8edbe2b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:49.108684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8c0d6dc6-31d0-4e36-a7f1-3a19c8edbe2b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:49.109140 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8c0d6dc6-31d0-4e36-a7f1-3a19c8edbe2b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:49.109562 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8c0d6dc6-31d0-4e36-a7f1-3a19c8edbe2b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:49.242072 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-8c0d6dc6-31d0-4e36-a7f1-3a19c8edbe2b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:49.249652 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8c0d6dc6-31d0-4e36-a7f1-3a19c8edbe2b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1266 microversion: 2.1 time: 0.153321 Sep 13 03:29:49.250215 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 437/908] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:49 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:50.273335 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f4982768-5562-4e7f-a317-042ab4f6bdd1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:50.273958 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f4982768-5562-4e7f-a317-042ab4f6bdd1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:50.280360 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f4982768-5562-4e7f-a317-042ab4f6bdd1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:50.280857 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f4982768-5562-4e7f-a317-042ab4f6bdd1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:50.281295 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f4982768-5562-4e7f-a317-042ab4f6bdd1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:50.281992 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f4982768-5562-4e7f-a317-042ab4f6bdd1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:50.282450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f4982768-5562-4e7f-a317-042ab4f6bdd1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:50.282899 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f4982768-5562-4e7f-a317-042ab4f6bdd1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:50.475990 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f4982768-5562-4e7f-a317-042ab4f6bdd1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:50.484402 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f4982768-5562-4e7f-a317-042ab4f6bdd1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1266 microversion: 2.1 time: 0.215397 Sep 13 03:29:50.486683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 472/909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:50 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:51.507708 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7f0b5303-8f33-4f60-b39a-24cc093f315d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:51.508325 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7f0b5303-8f33-4f60-b39a-24cc093f315d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:51.511697 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:51.515368 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f0b5303-8f33-4f60-b39a-24cc093f315d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:51.515859 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f0b5303-8f33-4f60-b39a-24cc093f315d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:51.516298 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f0b5303-8f33-4f60-b39a-24cc093f315d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:51.516992 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f0b5303-8f33-4f60-b39a-24cc093f315d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:51.517449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f0b5303-8f33-4f60-b39a-24cc093f315d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:51.517874 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f0b5303-8f33-4f60-b39a-24cc093f315d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:51.856968 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7f0b5303-8f33-4f60-b39a-24cc093f315d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:51.865430 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7f0b5303-8f33-4f60-b39a-24cc093f315d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1266 microversion: 2.1 time: 0.361340 Sep 13 03:29:51.865994 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 438/910] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:51 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1266 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:52.888475 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c58d96a0-9cf5-4afe-be08-56891a4790e9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:52.889027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c58d96a0-9cf5-4afe-be08-56891a4790e9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:52.890847 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:52.891601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=6 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:52.897512 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c58d96a0-9cf5-4afe-be08-56891a4790e9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:52.897999 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c58d96a0-9cf5-4afe-be08-56891a4790e9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:52.898438 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c58d96a0-9cf5-4afe-be08-56891a4790e9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:52.899156 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c58d96a0-9cf5-4afe-be08-56891a4790e9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:52.899613 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c58d96a0-9cf5-4afe-be08-56891a4790e9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:52.900041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c58d96a0-9cf5-4afe-be08-56891a4790e9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:53.029139 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c58d96a0-9cf5-4afe-be08-56891a4790e9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:53.036655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c58d96a0-9cf5-4afe-be08-56891a4790e9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1266 microversion: 2.1 time: 0.152076 Sep 13 03:29:53.037226 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 473/911] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:52 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:54.060996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-602c2154-822a-431e-bd65-de5a7bd27add tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:54.062204 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-602c2154-822a-431e-bd65-de5a7bd27add tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:54.068829 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-602c2154-822a-431e-bd65-de5a7bd27add tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:54.069322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-602c2154-822a-431e-bd65-de5a7bd27add tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:54.069937 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-602c2154-822a-431e-bd65-de5a7bd27add tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:54.070898 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-602c2154-822a-431e-bd65-de5a7bd27add tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:54.071515 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-602c2154-822a-431e-bd65-de5a7bd27add tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:54.072321 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-602c2154-822a-431e-bd65-de5a7bd27add tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:54.217069 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-602c2154-822a-431e-bd65-de5a7bd27add tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:54.226259 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-602c2154-822a-431e-bd65-de5a7bd27add tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1266 microversion: 2.1 time: 0.169946 Sep 13 03:29:54.226858 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 439/912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:54 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:55.249197 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ae4035ee-ab32-445b-a8af-36970d30502e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:55.249810 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ae4035ee-ab32-445b-a8af-36970d30502e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:55.255824 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae4035ee-ab32-445b-a8af-36970d30502e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:55.256309 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae4035ee-ab32-445b-a8af-36970d30502e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:55.256747 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae4035ee-ab32-445b-a8af-36970d30502e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:55.257439 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae4035ee-ab32-445b-a8af-36970d30502e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:55.257888 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae4035ee-ab32-445b-a8af-36970d30502e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:55.258311 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae4035ee-ab32-445b-a8af-36970d30502e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:55.391573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ae4035ee-ab32-445b-a8af-36970d30502e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:55.399742 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ae4035ee-ab32-445b-a8af-36970d30502e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1266 microversion: 2.1 time: 0.154406 Sep 13 03:29:55.400306 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 474/913] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:55 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:56.423099 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-42c492d2-dd72-4219-bea3-dc9bb73c2673 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:56.423719 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-42c492d2-dd72-4219-bea3-dc9bb73c2673 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:56.430718 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-42c492d2-dd72-4219-bea3-dc9bb73c2673 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:56.431207 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-42c492d2-dd72-4219-bea3-dc9bb73c2673 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:56.431644 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-42c492d2-dd72-4219-bea3-dc9bb73c2673 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:56.432329 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-42c492d2-dd72-4219-bea3-dc9bb73c2673 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:56.432778 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-42c492d2-dd72-4219-bea3-dc9bb73c2673 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:56.433198 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-42c492d2-dd72-4219-bea3-dc9bb73c2673 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:56.559591 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-42c492d2-dd72-4219-bea3-dc9bb73c2673 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:56.567114 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-42c492d2-dd72-4219-bea3-dc9bb73c2673 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1266 microversion: 2.1 time: 0.147804 Sep 13 03:29:56.567669 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 440/914] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:56 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:57.589520 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ca6ffc5c-62ed-4030-93f7-83fe2f3a631d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:57.590127 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ca6ffc5c-62ed-4030-93f7-83fe2f3a631d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:57.598551 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ca6ffc5c-62ed-4030-93f7-83fe2f3a631d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:57.599072 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ca6ffc5c-62ed-4030-93f7-83fe2f3a631d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:57.599500 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ca6ffc5c-62ed-4030-93f7-83fe2f3a631d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:57.600195 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ca6ffc5c-62ed-4030-93f7-83fe2f3a631d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:57.600653 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ca6ffc5c-62ed-4030-93f7-83fe2f3a631d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:57.601073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ca6ffc5c-62ed-4030-93f7-83fe2f3a631d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:57.734365 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ca6ffc5c-62ed-4030-93f7-83fe2f3a631d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:57.742819 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ca6ffc5c-62ed-4030-93f7-83fe2f3a631d tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1266 microversion: 2.1 time: 0.157118 Sep 13 03:29:57.743385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 475/915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:57 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:58.765461 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-31957ef6-c568-498b-947e-8d4b563a42b2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:58.766120 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-31957ef6-c568-498b-947e-8d4b563a42b2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:58.773535 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-31957ef6-c568-498b-947e-8d4b563a42b2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:58.774023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-31957ef6-c568-498b-947e-8d4b563a42b2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:58.774461 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-31957ef6-c568-498b-947e-8d4b563a42b2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:58.775184 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-31957ef6-c568-498b-947e-8d4b563a42b2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:58.775644 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-31957ef6-c568-498b-947e-8d4b563a42b2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:58.776066 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-31957ef6-c568-498b-947e-8d4b563a42b2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:58.951481 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-31957ef6-c568-498b-947e-8d4b563a42b2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:29:58.961616 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-31957ef6-c568-498b-947e-8d4b563a42b2 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1266 microversion: 2.1 time: 0.199956 Sep 13 03:29:58.963298 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 441/916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:58 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:29:58.986685 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-084f8dc8-8831-4dba-95cb-dd2d3fa520ec req-9598efcd-765b-4f5b-97af-d69426710319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47509aa-d316-494f-8446-a2f81a1f234c", "name": "network-vif-plugged", "status": "completed", "tag": "58cadb39-f080-4b49-bdc0-0bad103c6ae7"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:29:58.998786 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-084f8dc8-8831-4dba-95cb-dd2d3fa520ec req-9598efcd-765b-4f5b-97af-d69426710319 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:58.999378 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-084f8dc8-8831-4dba-95cb-dd2d3fa520ec req-9598efcd-765b-4f5b-97af-d69426710319 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:58.999883 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-084f8dc8-8831-4dba-95cb-dd2d3fa520ec req-9598efcd-765b-4f5b-97af-d69426710319 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:59.018158 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-084f8dc8-8831-4dba-95cb-dd2d3fa520ec req-9598efcd-765b-4f5b-97af-d69426710319 service nova] Creating event network-vif-plugged:58cadb39-f080-4b49-bdc0-0bad103c6ae7 for instance e47509aa-d316-494f-8446-a2f81a1f234c on hv-cinder-85707 Sep 13 03:29:59.025963 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-084f8dc8-8831-4dba-95cb-dd2d3fa520ec req-9598efcd-765b-4f5b-97af-d69426710319 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044852 Sep 13 03:29:59.026986 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 476/917] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:29:59.985615 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7b9dce5c-ae0c-4773-807e-25c5c17460b1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:29:59.986315 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7b9dce5c-ae0c-4773-807e-25c5c17460b1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:29:59.992906 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7b9dce5c-ae0c-4773-807e-25c5c17460b1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:59.993481 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7b9dce5c-ae0c-4773-807e-25c5c17460b1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:59.994033 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7b9dce5c-ae0c-4773-807e-25c5c17460b1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:29:59.994839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7b9dce5c-ae0c-4773-807e-25c5c17460b1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:29:59.995405 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7b9dce5c-ae0c-4773-807e-25c5c17460b1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:29:59.995888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7b9dce5c-ae0c-4773-807e-25c5c17460b1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:00.194413 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7b9dce5c-ae0c-4773-807e-25c5c17460b1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:00.202166 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7b9dce5c-ae0c-4773-807e-25c5c17460b1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1266 microversion: 2.1 time: 0.221338 Sep 13 03:30:00.202959 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 442/918] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:29:59 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:01.227147 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1baab200-c269-40e7-9336-3b37cbf1253e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:01.227939 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1baab200-c269-40e7-9336-3b37cbf1253e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:01.236107 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1baab200-c269-40e7-9336-3b37cbf1253e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:01.236832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1baab200-c269-40e7-9336-3b37cbf1253e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:01.237278 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1baab200-c269-40e7-9336-3b37cbf1253e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:01.238447 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1baab200-c269-40e7-9336-3b37cbf1253e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:01.239149 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1baab200-c269-40e7-9336-3b37cbf1253e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:01.239580 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1baab200-c269-40e7-9336-3b37cbf1253e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:01.491820 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1baab200-c269-40e7-9336-3b37cbf1253e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:01.502027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1baab200-c269-40e7-9336-3b37cbf1253e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1452 microversion: 2.1 time: 0.280248 Sep 13 03:30:01.503024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 477/919] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:01 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1452 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:01.527200 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-87c7fa6c-7495-4b9b-90e0-108eff636d36 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:01.528081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-87c7fa6c-7495-4b9b-90e0-108eff636d36 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:01.535640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87c7fa6c-7495-4b9b-90e0-108eff636d36 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:01.538083 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87c7fa6c-7495-4b9b-90e0-108eff636d36 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:01.539030 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87c7fa6c-7495-4b9b-90e0-108eff636d36 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:01.541041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87c7fa6c-7495-4b9b-90e0-108eff636d36 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:01.541757 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87c7fa6c-7495-4b9b-90e0-108eff636d36 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:01.542455 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87c7fa6c-7495-4b9b-90e0-108eff636d36 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:01.547854 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:01.763577 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-87c7fa6c-7495-4b9b-90e0-108eff636d36 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:01.773647 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-87c7fa6c-7495-4b9b-90e0-108eff636d36 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1452 microversion: 2.1 time: 0.250756 Sep 13 03:30:01.782653 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 443/920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:01 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1452 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:03.625600 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-11566d5b-b06a-4a3a-b75d-648108325f66 req-aaf06b2a-47f0-4d3a-af19-15cac11e3c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47509aa-d316-494f-8446-a2f81a1f234c", "tag": "58cadb39-f080-4b49-bdc0-0bad103c6ae7"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:03.636775 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-11566d5b-b06a-4a3a-b75d-648108325f66 req-aaf06b2a-47f0-4d3a-af19-15cac11e3c17 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:03.637512 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-11566d5b-b06a-4a3a-b75d-648108325f66 req-aaf06b2a-47f0-4d3a-af19-15cac11e3c17 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:03.638101 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-11566d5b-b06a-4a3a-b75d-648108325f66 req-aaf06b2a-47f0-4d3a-af19-15cac11e3c17 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:03.652588 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-11566d5b-b06a-4a3a-b75d-648108325f66 req-aaf06b2a-47f0-4d3a-af19-15cac11e3c17 service nova] Creating event network-changed:58cadb39-f080-4b49-bdc0-0bad103c6ae7 for instance e47509aa-d316-494f-8446-a2f81a1f234c on hv-cinder-85707 Sep 13 03:30:03.658437 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-11566d5b-b06a-4a3a-b75d-648108325f66 req-aaf06b2a-47f0-4d3a-af19-15cac11e3c17 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036286 Sep 13 03:30:03.660464 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 478/921] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:30:20.340598 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6da11e90-9a84-439b-8631-54da01459371 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Action: 'create', calling method: .version_select at 0x7f8935678700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1347009506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyUw/U1a5zft5p5teOI42bopdN8ftxd/JLV2WPeUqVJsInfub8Yidp6DkWbbjOdnm5HO0vjodYkXlXwdmU8pHUTZAaIKCxdACUx3uxKTjQj+626z/j4l5C5m+KHzcz2YQ=="}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:20.346690 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=19 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:20.347336 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=5 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:20.358796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-6da11e90-9a84-439b-8631-54da01459371 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Getting quotas for project 35d0f9365a60474590ea1bb78b1654b2. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:30:20.362551 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-6da11e90-9a84-439b-8631-54da01459371 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Getting quotas for user 92bba932a70f4a75b1bb1810d8826447 and project 35d0f9365a60474590ea1bb78b1654b2. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:30:20.383615 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6da11e90-9a84-439b-8631-54da01459371 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046761 Sep 13 03:30:20.384207 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 444/922] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 03:30:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:30:20.438362 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:20.439133 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=50 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:20.444280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-77193215", "imageRef": "d4cb5cec-4562-4af1-8d5d-14cf4892a095", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1347009506", "networks": [{"uuid": "250124f3-9050-45ee-884e-2007ff51f342"}]}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:20.496783 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.network.neutron [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] validate_networks() for [('250124f3-9050-45ee-884e-2007ff51f342', None, None, None, None, None)] {{(pid=120383) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:30:20.860920 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Flavor limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:30:20.861344 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Image limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:30:20.861814 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Flavor pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:30:20.862216 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Image pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:30:20.862648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:30:20.871674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:20.872150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:20.872575 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:20.873288 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:20.873735 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:20.874151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:20.890970 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Getting quotas for project 35d0f9365a60474590ea1bb78b1654b2. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:30:20.894867 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Getting quotas for user 92bba932a70f4a75b1bb1810d8826447 and project 35d0f9365a60474590ea1bb78b1654b2. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:30:20.905372 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Going to run 1 instances... {{(pid=120383) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:30:20.907658 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4cb5cec-4562-4af1-8d5d-14cf4892a095',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:30:20.953760 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c925d7c8-973c-4d2f-985d-ff431c5fae0c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517108 Sep 13 03:30:20.954401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 479/923] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:30:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:30:20.965543 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b43678e5-e42b-4a7d-bdbd-cd724e3bdd8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:20.966317 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b43678e5-e42b-4a7d-bdbd-cd724e3bdd8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:21.022749 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b43678e5-e42b-4a7d-bdbd-cd724e3bdd8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:21.030755 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b43678e5-e42b-4a7d-bdbd-cd724e3bdd8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1257 microversion: 2.1 time: 0.069057 Sep 13 03:30:21.031518 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 445/924] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:20 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:22.055942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-641b1c21-75f0-4a27-ba3a-eaffb6d84e53 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:22.056554 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-641b1c21-75f0-4a27-ba3a-eaffb6d84e53 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:22.064405 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-641b1c21-75f0-4a27-ba3a-eaffb6d84e53 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:22.064898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-641b1c21-75f0-4a27-ba3a-eaffb6d84e53 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:22.065336 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-641b1c21-75f0-4a27-ba3a-eaffb6d84e53 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:22.066029 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-641b1c21-75f0-4a27-ba3a-eaffb6d84e53 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:22.066484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-641b1c21-75f0-4a27-ba3a-eaffb6d84e53 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:22.067521 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-641b1c21-75f0-4a27-ba3a-eaffb6d84e53 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:22.133779 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-641b1c21-75f0-4a27-ba3a-eaffb6d84e53 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:22.142195 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-641b1c21-75f0-4a27-ba3a-eaffb6d84e53 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1309 microversion: 2.1 time: 0.091942 Sep 13 03:30:22.142813 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 480/925] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:22 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:23.173527 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a007406a-dce0-4333-8d0d-4b78850e0edd tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:23.173987 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a007406a-dce0-4333-8d0d-4b78850e0edd tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:23.182501 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a007406a-dce0-4333-8d0d-4b78850e0edd tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:23.183294 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a007406a-dce0-4333-8d0d-4b78850e0edd tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:23.183881 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a007406a-dce0-4333-8d0d-4b78850e0edd tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:23.184952 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a007406a-dce0-4333-8d0d-4b78850e0edd tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:23.185412 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a007406a-dce0-4333-8d0d-4b78850e0edd tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:23.185835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a007406a-dce0-4333-8d0d-4b78850e0edd tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:23.354300 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a007406a-dce0-4333-8d0d-4b78850e0edd tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:23.362087 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a007406a-dce0-4333-8d0d-4b78850e0edd tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.200351 Sep 13 03:30:23.362660 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 446/926] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:23 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:24.385112 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-86a71e2e-bcae-420b-b237-f057ef6d89f1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:24.385630 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-86a71e2e-bcae-420b-b237-f057ef6d89f1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:24.391983 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-86a71e2e-bcae-420b-b237-f057ef6d89f1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:24.392471 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-86a71e2e-bcae-420b-b237-f057ef6d89f1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:24.392906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-86a71e2e-bcae-420b-b237-f057ef6d89f1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:24.393594 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-86a71e2e-bcae-420b-b237-f057ef6d89f1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:24.394050 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-86a71e2e-bcae-420b-b237-f057ef6d89f1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:24.394475 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-86a71e2e-bcae-420b-b237-f057ef6d89f1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:24.531274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-86a71e2e-bcae-420b-b237-f057ef6d89f1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:24.540225 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-86a71e2e-bcae-420b-b237-f057ef6d89f1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.159020 Sep 13 03:30:24.540888 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 481/927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:24 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:25.562827 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3a83f5c3-c22a-485f-812d-9ffc65eff04b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:25.563617 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3a83f5c3-c22a-485f-812d-9ffc65eff04b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:25.570224 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3a83f5c3-c22a-485f-812d-9ffc65eff04b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:25.570757 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3a83f5c3-c22a-485f-812d-9ffc65eff04b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:25.571206 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3a83f5c3-c22a-485f-812d-9ffc65eff04b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:25.571909 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3a83f5c3-c22a-485f-812d-9ffc65eff04b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:25.572370 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3a83f5c3-c22a-485f-812d-9ffc65eff04b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:25.572790 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3a83f5c3-c22a-485f-812d-9ffc65eff04b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:25.707369 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3a83f5c3-c22a-485f-812d-9ffc65eff04b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:25.716269 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3a83f5c3-c22a-485f-812d-9ffc65eff04b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.157212 Sep 13 03:30:25.717008 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 447/928] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:25 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:26.740093 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9d98c47f-f085-489d-857f-4bf4dbd2ffb2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:26.740705 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9d98c47f-f085-489d-857f-4bf4dbd2ffb2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:26.746501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9d98c47f-f085-489d-857f-4bf4dbd2ffb2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:26.747011 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9d98c47f-f085-489d-857f-4bf4dbd2ffb2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:26.747448 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9d98c47f-f085-489d-857f-4bf4dbd2ffb2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:26.748126 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9d98c47f-f085-489d-857f-4bf4dbd2ffb2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:26.748577 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9d98c47f-f085-489d-857f-4bf4dbd2ffb2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:26.749014 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9d98c47f-f085-489d-857f-4bf4dbd2ffb2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:26.890655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9d98c47f-f085-489d-857f-4bf4dbd2ffb2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:26.903712 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9d98c47f-f085-489d-857f-4bf4dbd2ffb2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.167959 Sep 13 03:30:26.904619 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 482/929] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:26 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:27.926678 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5c54480a-2cca-4a85-a024-5aa168f3015d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:27.927295 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5c54480a-2cca-4a85-a024-5aa168f3015d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:27.933751 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c54480a-2cca-4a85-a024-5aa168f3015d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:27.934233 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c54480a-2cca-4a85-a024-5aa168f3015d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:27.934695 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c54480a-2cca-4a85-a024-5aa168f3015d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:27.935399 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c54480a-2cca-4a85-a024-5aa168f3015d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:27.935876 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c54480a-2cca-4a85-a024-5aa168f3015d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:27.936294 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c54480a-2cca-4a85-a024-5aa168f3015d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:28.100422 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5c54480a-2cca-4a85-a024-5aa168f3015d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:28.122800 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5c54480a-2cca-4a85-a024-5aa168f3015d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.199160 Sep 13 03:30:28.123851 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 448/930] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:27 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:29.149474 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7326b08a-65bc-45d0-86cd-dd5b14bd1a8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:29.150084 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7326b08a-65bc-45d0-86cd-dd5b14bd1a8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:29.158221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7326b08a-65bc-45d0-86cd-dd5b14bd1a8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:29.158946 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7326b08a-65bc-45d0-86cd-dd5b14bd1a8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:29.159714 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7326b08a-65bc-45d0-86cd-dd5b14bd1a8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:29.160495 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7326b08a-65bc-45d0-86cd-dd5b14bd1a8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:29.160853 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7326b08a-65bc-45d0-86cd-dd5b14bd1a8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:29.161274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7326b08a-65bc-45d0-86cd-dd5b14bd1a8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:29.334355 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7326b08a-65bc-45d0-86cd-dd5b14bd1a8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:29.342547 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7326b08a-65bc-45d0-86cd-dd5b14bd1a8a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.196994 Sep 13 03:30:29.343554 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 483/931] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:29 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:30.367733 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-63b51a0d-a72a-44b3-90ef-274c62e6c417 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:30.368544 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-63b51a0d-a72a-44b3-90ef-274c62e6c417 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:30.376083 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-63b51a0d-a72a-44b3-90ef-274c62e6c417 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:30.376609 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-63b51a0d-a72a-44b3-90ef-274c62e6c417 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:30.377046 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-63b51a0d-a72a-44b3-90ef-274c62e6c417 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:30.377759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-63b51a0d-a72a-44b3-90ef-274c62e6c417 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:30.378213 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-63b51a0d-a72a-44b3-90ef-274c62e6c417 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:30.378755 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-63b51a0d-a72a-44b3-90ef-274c62e6c417 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:30.551544 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-63b51a0d-a72a-44b3-90ef-274c62e6c417 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:30.559682 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-63b51a0d-a72a-44b3-90ef-274c62e6c417 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.197926 Sep 13 03:30:30.566277 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 449/932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:30 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:31.583002 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4b5e071c-6346-41e9-8fe1-b661e1abd82d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:31.583537 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4b5e071c-6346-41e9-8fe1-b661e1abd82d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:31.585802 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:31.586784 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=6 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:31.592824 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5e071c-6346-41e9-8fe1-b661e1abd82d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:31.593308 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5e071c-6346-41e9-8fe1-b661e1abd82d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:31.593795 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5e071c-6346-41e9-8fe1-b661e1abd82d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:31.594470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5e071c-6346-41e9-8fe1-b661e1abd82d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:31.594955 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5e071c-6346-41e9-8fe1-b661e1abd82d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:31.595373 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4b5e071c-6346-41e9-8fe1-b661e1abd82d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:31.749389 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4b5e071c-6346-41e9-8fe1-b661e1abd82d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:31.759265 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4b5e071c-6346-41e9-8fe1-b661e1abd82d tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.180559 Sep 13 03:30:31.769039 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 484/933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:31 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:31.954754 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c03bcf88-2f38-47ff-b850-89db4f00319c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:31.955388 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c03bcf88-2f38-47ff-b850-89db4f00319c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:31.957897 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=6 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:31.966859 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c03bcf88-2f38-47ff-b850-89db4f00319c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:31.967360 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c03bcf88-2f38-47ff-b850-89db4f00319c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:31.967796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c03bcf88-2f38-47ff-b850-89db4f00319c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:31.968496 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c03bcf88-2f38-47ff-b850-89db4f00319c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:31.968942 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c03bcf88-2f38-47ff-b850-89db4f00319c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:31.970706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c03bcf88-2f38-47ff-b850-89db4f00319c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:31.995307 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c03bcf88-2f38-47ff-b850-89db4f00319c tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/ips" status: 200 len: 151 microversion: 2.1 time: 0.044467 Sep 13 03:30:31.996133 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 450/934] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 03:30:31 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:30:32.783794 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-603589f1-e452-494c-8fe9-423b4278c764 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:32.784446 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-603589f1-e452-494c-8fe9-423b4278c764 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:32.791385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-603589f1-e452-494c-8fe9-423b4278c764 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:32.791885 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-603589f1-e452-494c-8fe9-423b4278c764 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:32.792330 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-603589f1-e452-494c-8fe9-423b4278c764 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:32.793026 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-603589f1-e452-494c-8fe9-423b4278c764 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:32.793706 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-603589f1-e452-494c-8fe9-423b4278c764 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:32.794138 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-603589f1-e452-494c-8fe9-423b4278c764 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:32.925091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-603589f1-e452-494c-8fe9-423b4278c764 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:32.935045 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-603589f1-e452-494c-8fe9-423b4278c764 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.155178 Sep 13 03:30:32.935622 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 485/935] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:32 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:33.957288 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3169473e-9806-4a75-9998-d8844cb545aa tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:33.958510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3169473e-9806-4a75-9998-d8844cb545aa tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:33.966291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3169473e-9806-4a75-9998-d8844cb545aa tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:33.966820 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3169473e-9806-4a75-9998-d8844cb545aa tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:33.967248 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3169473e-9806-4a75-9998-d8844cb545aa tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:33.967931 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3169473e-9806-4a75-9998-d8844cb545aa tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:33.968388 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3169473e-9806-4a75-9998-d8844cb545aa tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:33.968802 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3169473e-9806-4a75-9998-d8844cb545aa tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:34.102397 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3169473e-9806-4a75-9998-d8844cb545aa tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:34.110112 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3169473e-9806-4a75-9998-d8844cb545aa tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.156643 Sep 13 03:30:34.110688 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 451/936] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:33 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:34.413067 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cecba0e6-4896-44c4-a82c-0595aa253215 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2356cab-d4a8-4da6-81da-fc92dc6d9a15"}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:34.415779 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-cecba0e6-4896-44c4-a82c-0595aa253215 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:34.422090 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cecba0e6-4896-44c4-a82c-0595aa253215 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:34.422806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cecba0e6-4896-44c4-a82c-0595aa253215 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:34.423420 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cecba0e6-4896-44c4-a82c-0595aa253215 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:34.424107 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cecba0e6-4896-44c4-a82c-0595aa253215 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:34.424564 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cecba0e6-4896-44c4-a82c-0595aa253215 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:34.424984 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cecba0e6-4896-44c4-a82c-0595aa253215 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:35.133189 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-38a36816-c9e7-42c7-bacf-7d9582ad9112 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:35.133799 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-38a36816-c9e7-42c7-bacf-7d9582ad9112 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:35.140158 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38a36816-c9e7-42c7-bacf-7d9582ad9112 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:35.140641 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38a36816-c9e7-42c7-bacf-7d9582ad9112 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:35.141070 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38a36816-c9e7-42c7-bacf-7d9582ad9112 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:35.141747 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38a36816-c9e7-42c7-bacf-7d9582ad9112 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:35.142194 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38a36816-c9e7-42c7-bacf-7d9582ad9112 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:35.142638 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-38a36816-c9e7-42c7-bacf-7d9582ad9112 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:35.277798 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-38a36816-c9e7-42c7-bacf-7d9582ad9112 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:35.285368 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-38a36816-c9e7-42c7-bacf-7d9582ad9112 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.156067 Sep 13 03:30:35.285931 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 452/937] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:35 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:30:35.734350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-cecba0e6-4896-44c4-a82c-0595aa253215 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.325499 Sep 13 03:30:35.735759 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 486/938] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:30:34 2022] POST /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-volume_attachments => generated 194 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:30:36.308593 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a3b5e30b-36c0-4755-81be-e4085870cf11 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:36.309359 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a3b5e30b-36c0-4755-81be-e4085870cf11 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:36.316730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a3b5e30b-36c0-4755-81be-e4085870cf11 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:36.317436 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a3b5e30b-36c0-4755-81be-e4085870cf11 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:36.318255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a3b5e30b-36c0-4755-81be-e4085870cf11 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:36.319001 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a3b5e30b-36c0-4755-81be-e4085870cf11 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:36.319749 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a3b5e30b-36c0-4755-81be-e4085870cf11 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:36.320267 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a3b5e30b-36c0-4755-81be-e4085870cf11 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:36.472282 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-5007ff27-5f64-4ff6-825c-ff3b02cd66ea req-d12b88f6-5bef-4323-b047-45e403a83903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c5c35a-9c3f-4796-a202-214bcff70431", "tag": "fd8213ce-3653-4272-bd22-22e80d1944df"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:36.509202 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-5007ff27-5f64-4ff6-825c-ff3b02cd66ea req-d12b88f6-5bef-4323-b047-45e403a83903 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:36.509722 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-5007ff27-5f64-4ff6-825c-ff3b02cd66ea req-d12b88f6-5bef-4323-b047-45e403a83903 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:36.510423 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-5007ff27-5f64-4ff6-825c-ff3b02cd66ea req-d12b88f6-5bef-4323-b047-45e403a83903 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:36.525200 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-5007ff27-5f64-4ff6-825c-ff3b02cd66ea req-d12b88f6-5bef-4323-b047-45e403a83903 service nova] Creating event network-changed:fd8213ce-3653-4272-bd22-22e80d1944df for instance d4c5c35a-9c3f-4796-a202-214bcff70431 on hv-cinder-85707 Sep 13 03:30:36.530643 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-5007ff27-5f64-4ff6-825c-ff3b02cd66ea req-d12b88f6-5bef-4323-b047-45e403a83903 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062352 Sep 13 03:30:36.531601 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 487/939] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:30:36.617657 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a3b5e30b-36c0-4755-81be-e4085870cf11 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:36.625879 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a3b5e30b-36c0-4755-81be-e4085870cf11 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.321123 Sep 13 03:30:36.626448 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 453/940] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:36 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:37.648991 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-250f6afd-5a0f-4ff5-a186-21777b2e616b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:37.649618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-250f6afd-5a0f-4ff5-a186-21777b2e616b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:37.656341 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-250f6afd-5a0f-4ff5-a186-21777b2e616b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:37.656827 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-250f6afd-5a0f-4ff5-a186-21777b2e616b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:37.657263 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-250f6afd-5a0f-4ff5-a186-21777b2e616b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:37.657984 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-250f6afd-5a0f-4ff5-a186-21777b2e616b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:37.658441 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-250f6afd-5a0f-4ff5-a186-21777b2e616b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:37.658891 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-250f6afd-5a0f-4ff5-a186-21777b2e616b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:37.795138 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-250f6afd-5a0f-4ff5-a186-21777b2e616b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:37.804465 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-250f6afd-5a0f-4ff5-a186-21777b2e616b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.159770 Sep 13 03:30:37.805031 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 488/941] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:37 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:38.826206 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b1c974ec-dd28-4ad4-86c2-8c9fedd4c33f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:38.826839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b1c974ec-dd28-4ad4-86c2-8c9fedd4c33f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:38.833276 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b1c974ec-dd28-4ad4-86c2-8c9fedd4c33f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:38.833754 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b1c974ec-dd28-4ad4-86c2-8c9fedd4c33f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:38.834180 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b1c974ec-dd28-4ad4-86c2-8c9fedd4c33f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:38.834878 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b1c974ec-dd28-4ad4-86c2-8c9fedd4c33f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:38.835332 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b1c974ec-dd28-4ad4-86c2-8c9fedd4c33f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:38.835748 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b1c974ec-dd28-4ad4-86c2-8c9fedd4c33f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:38.964542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b1c974ec-dd28-4ad4-86c2-8c9fedd4c33f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:38.972127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b1c974ec-dd28-4ad4-86c2-8c9fedd4c33f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.149713 Sep 13 03:30:38.972673 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 454/942] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:38 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:39.995790 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b2c59695-5c3c-413f-8e6e-b71e0c1ec39a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:39.996651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b2c59695-5c3c-413f-8e6e-b71e0c1ec39a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:40.003962 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2c59695-5c3c-413f-8e6e-b71e0c1ec39a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:40.004997 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2c59695-5c3c-413f-8e6e-b71e0c1ec39a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:40.005524 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2c59695-5c3c-413f-8e6e-b71e0c1ec39a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:40.006419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2c59695-5c3c-413f-8e6e-b71e0c1ec39a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:40.006967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2c59695-5c3c-413f-8e6e-b71e0c1ec39a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:40.007463 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2c59695-5c3c-413f-8e6e-b71e0c1ec39a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:40.312795 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b2c59695-5c3c-413f-8e6e-b71e0c1ec39a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:40.321269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b2c59695-5c3c-413f-8e6e-b71e0c1ec39a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.329675 Sep 13 03:30:40.334803 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 489/943] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:39 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:40.743249 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-71164968-c72c-42a2-b9f1-2ea2919365be tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:40.743781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-71164968-c72c-42a2-b9f1-2ea2919365be tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:40.745804 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-e4375e74-a974-4275-b446-b467cddc8546 req-7a8fd435-895e-4dad-8587-18c7e589e7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae88f2e-fe4e-46c6-bf5a-0381e90e26c6", "tag": "802c0f2a-3726-4731-b295-4046e1e4707e"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:40.750155 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-71164968-c72c-42a2-b9f1-2ea2919365be tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:40.750961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-71164968-c72c-42a2-b9f1-2ea2919365be tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:40.751414 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-71164968-c72c-42a2-b9f1-2ea2919365be tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:40.752097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-71164968-c72c-42a2-b9f1-2ea2919365be tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:40.752545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-71164968-c72c-42a2-b9f1-2ea2919365be tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:40.753225 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-71164968-c72c-42a2-b9f1-2ea2919365be tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:40.757709 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-e4375e74-a974-4275-b446-b467cddc8546 req-7a8fd435-895e-4dad-8587-18c7e589e7e5 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:40.758222 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-e4375e74-a974-4275-b446-b467cddc8546 req-7a8fd435-895e-4dad-8587-18c7e589e7e5 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:40.758682 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-e4375e74-a974-4275-b446-b467cddc8546 req-7a8fd435-895e-4dad-8587-18c7e589e7e5 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:40.771559 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-e4375e74-a974-4275-b446-b467cddc8546 req-7a8fd435-895e-4dad-8587-18c7e589e7e5 service nova] Creating event network-changed:802c0f2a-3726-4731-b295-4046e1e4707e for instance aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 on hv-cinder-85707 Sep 13 03:30:40.776764 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-e4375e74-a974-4275-b446-b467cddc8546 req-7a8fd435-895e-4dad-8587-18c7e589e7e5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034571 Sep 13 03:30:40.777541 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 490/944] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:30:40.779753 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-71164968-c72c-42a2-b9f1-2ea2919365be tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:30:40.876100 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-71164968-c72c-42a2-b9f1-2ea2919365be tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 204 len: 0 microversion: 2.1 time: 0.137125 Sep 13 03:30:40.876699 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 455/945] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:30:40 2022] DELETE /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:30:40.885396 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a8e9b67b-a856-4686-9418-e338e4431888 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:40.886123 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a8e9b67b-a856-4686-9418-e338e4431888 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:40.892169 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a8e9b67b-a856-4686-9418-e338e4431888 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:40.892650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a8e9b67b-a856-4686-9418-e338e4431888 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:40.893082 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a8e9b67b-a856-4686-9418-e338e4431888 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:40.893763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a8e9b67b-a856-4686-9418-e338e4431888 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:40.894250 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a8e9b67b-a856-4686-9418-e338e4431888 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:40.895229 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a8e9b67b-a856-4686-9418-e338e4431888 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:41.185239 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a8e9b67b-a856-4686-9418-e338e4431888 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:41.193379 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a8e9b67b-a856-4686-9418-e338e4431888 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.312228 Sep 13 03:30:41.193938 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 491/946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:40 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:30:41.345172 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b72f5070-f6dd-445f-a9ec-9d523b261d32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:41.346258 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b72f5070-f6dd-445f-a9ec-9d523b261d32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:41.352318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b72f5070-f6dd-445f-a9ec-9d523b261d32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:41.352814 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b72f5070-f6dd-445f-a9ec-9d523b261d32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:41.353243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b72f5070-f6dd-445f-a9ec-9d523b261d32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:41.353928 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b72f5070-f6dd-445f-a9ec-9d523b261d32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:41.354376 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b72f5070-f6dd-445f-a9ec-9d523b261d32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:41.354820 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b72f5070-f6dd-445f-a9ec-9d523b261d32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:41.485963 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b72f5070-f6dd-445f-a9ec-9d523b261d32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:41.493524 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b72f5070-f6dd-445f-a9ec-9d523b261d32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.152584 Sep 13 03:30:41.506635 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 456/947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:41 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:30:42.216715 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f2a64bdb-ce26-4637-8bb5-af996070fa9b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:42.217327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f2a64bdb-ce26-4637-8bb5-af996070fa9b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:42.223763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2a64bdb-ce26-4637-8bb5-af996070fa9b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:42.224242 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2a64bdb-ce26-4637-8bb5-af996070fa9b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:42.224675 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2a64bdb-ce26-4637-8bb5-af996070fa9b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:42.225355 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2a64bdb-ce26-4637-8bb5-af996070fa9b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:42.225806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2a64bdb-ce26-4637-8bb5-af996070fa9b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:42.226232 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2a64bdb-ce26-4637-8bb5-af996070fa9b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:42.413594 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f2a64bdb-ce26-4637-8bb5-af996070fa9b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:42.421439 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f2a64bdb-ce26-4637-8bb5-af996070fa9b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.208466 Sep 13 03:30:42.421991 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 492/948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:42 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:42.516773 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-442228d3-d7fe-4728-8bab-377624cdb348 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:42.517404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-442228d3-d7fe-4728-8bab-377624cdb348 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:42.523741 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-442228d3-d7fe-4728-8bab-377624cdb348 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:42.524243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-442228d3-d7fe-4728-8bab-377624cdb348 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:42.524669 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-442228d3-d7fe-4728-8bab-377624cdb348 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:42.525355 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-442228d3-d7fe-4728-8bab-377624cdb348 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:42.525808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-442228d3-d7fe-4728-8bab-377624cdb348 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:42.526232 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-442228d3-d7fe-4728-8bab-377624cdb348 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:42.653618 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-442228d3-d7fe-4728-8bab-377624cdb348 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:42.661764 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-442228d3-d7fe-4728-8bab-377624cdb348 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.148767 Sep 13 03:30:42.662291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 457/949] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:42 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:43.445442 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-eb315ce1-9b83-4d26-aa17-9c00e366f14e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:43.446095 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-eb315ce1-9b83-4d26-aa17-9c00e366f14e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:43.452892 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eb315ce1-9b83-4d26-aa17-9c00e366f14e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:43.453404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eb315ce1-9b83-4d26-aa17-9c00e366f14e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:43.453832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eb315ce1-9b83-4d26-aa17-9c00e366f14e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:43.454528 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eb315ce1-9b83-4d26-aa17-9c00e366f14e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:43.455014 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eb315ce1-9b83-4d26-aa17-9c00e366f14e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:43.455435 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eb315ce1-9b83-4d26-aa17-9c00e366f14e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:43.589632 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-8145f597-684c-4c07-a319-83d6e9244915 req-333a31bc-1a8c-4f84-a51b-f1b2b331c200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c5c35a-9c3f-4796-a202-214bcff70431", "name": "network-vif-plugged", "status": "completed", "tag": "fd8213ce-3653-4272-bd22-22e80d1944df"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:43.590703 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-eb315ce1-9b83-4d26-aa17-9c00e366f14e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:43.599736 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-eb315ce1-9b83-4d26-aa17-9c00e366f14e tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1568 microversion: 2.1 time: 0.158559 Sep 13 03:30:43.600536 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-8145f597-684c-4c07-a319-83d6e9244915 req-333a31bc-1a8c-4f84-a51b-f1b2b331c200 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:43.600675 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 493/950] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:43 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:43.601489 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-8145f597-684c-4c07-a319-83d6e9244915 req-333a31bc-1a8c-4f84-a51b-f1b2b331c200 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:43.601929 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-8145f597-684c-4c07-a319-83d6e9244915 req-333a31bc-1a8c-4f84-a51b-f1b2b331c200 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:43.614501 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-8145f597-684c-4c07-a319-83d6e9244915 req-333a31bc-1a8c-4f84-a51b-f1b2b331c200 service nova] Creating event network-vif-plugged:fd8213ce-3653-4272-bd22-22e80d1944df for instance d4c5c35a-9c3f-4796-a202-214bcff70431 on hv-cinder-85707 Sep 13 03:30:43.619240 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-8145f597-684c-4c07-a319-83d6e9244915 req-333a31bc-1a8c-4f84-a51b-f1b2b331c200 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033322 Sep 13 03:30:43.619827 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 458/951] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:30:43.684700 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-578db6fb-d155-4ddb-a6cd-2d93afe7ab44 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:43.685320 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-578db6fb-d155-4ddb-a6cd-2d93afe7ab44 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:43.691138 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-578db6fb-d155-4ddb-a6cd-2d93afe7ab44 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:43.692148 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-578db6fb-d155-4ddb-a6cd-2d93afe7ab44 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:43.692583 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-578db6fb-d155-4ddb-a6cd-2d93afe7ab44 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:43.693241 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-578db6fb-d155-4ddb-a6cd-2d93afe7ab44 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:43.693690 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-578db6fb-d155-4ddb-a6cd-2d93afe7ab44 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:43.694106 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-578db6fb-d155-4ddb-a6cd-2d93afe7ab44 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:43.858948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-578db6fb-d155-4ddb-a6cd-2d93afe7ab44 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:43.866980 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-578db6fb-d155-4ddb-a6cd-2d93afe7ab44 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.186070 Sep 13 03:30:43.867529 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 494/952] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:43 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:44.359476 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3934affb-99dc-41bd-8a9d-92574c5a2df5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2356cab-d4a8-4da6-81da-fc92dc6d9a15"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:44.362005 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3934affb-99dc-41bd-8a9d-92574c5a2df5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:44.370039 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3934affb-99dc-41bd-8a9d-92574c5a2df5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:44.370540 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3934affb-99dc-41bd-8a9d-92574c5a2df5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:44.371006 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3934affb-99dc-41bd-8a9d-92574c5a2df5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:44.371746 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3934affb-99dc-41bd-8a9d-92574c5a2df5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:44.372206 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3934affb-99dc-41bd-8a9d-92574c5a2df5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:44.372818 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3934affb-99dc-41bd-8a9d-92574c5a2df5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:44.432973 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-952853a0-6ee7-40b5-ac22-a30a73b8cb5c req-5af76d40-0b65-4156-94b7-11265d647795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae88f2e-fe4e-46c6-bf5a-0381e90e26c6", "name": "network-vif-deleted", "tag": "802c0f2a-3726-4731-b295-4046e1e4707e"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:44.447161 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-952853a0-6ee7-40b5-ac22-a30a73b8cb5c req-5af76d40-0b65-4156-94b7-11265d647795 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:44.448754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-952853a0-6ee7-40b5-ac22-a30a73b8cb5c req-5af76d40-0b65-4156-94b7-11265d647795 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:44.449849 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-952853a0-6ee7-40b5-ac22-a30a73b8cb5c req-5af76d40-0b65-4156-94b7-11265d647795 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:44.463127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-3934affb-99dc-41bd-8a9d-92574c5a2df5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Invalid volume: volume a2356cab-d4a8-4da6-81da-fc92dc6d9a15 is already attached to instances: d0446c67-3992-4af8-9863-0eed6088d0a7 Sep 13 03:30:44.463478 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-952853a0-6ee7-40b5-ac22-a30a73b8cb5c req-5af76d40-0b65-4156-94b7-11265d647795 service nova] Creating event network-vif-deleted:802c0f2a-3726-4731-b295-4046e1e4707e for instance aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 on hv-cinder-85707 Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3934affb-99dc-41bd-8a9d-92574c5a2df5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: POST /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-volume_attachments HTTP/1.1 Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 74 Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:30:44.465094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:30:44.466558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:30:44.466558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:30:44.466558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:30:44.466558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:30:44.466558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:30:44.466558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:30:44.466558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:30:44.466558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:30:44.466558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:30:44.466558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Sep 13 03:30:44.466558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {"volumeAttachment": {"volumeId": "a2356cab-d4a8-4da6-81da-fc92dc6d9a15"}} Sep 13 03:30:44.466558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Invalid volume: volume a2356cab-d4a8-4da6-81da-fc92dc6d9a15 is already attached to instances: d0446c67-3992-4af8-9863-0eed6088d0a7 Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'server_id': 'd0446c67-3992-4af8-9863-0eed6088d0a7', 'body': {'volumeAttachment': {'volumeId': 'a2356cab-d4a8-4da6-81da-fc92dc6d9a15'}}} Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a2356cab-d4a8-4da6-81da-fc92dc6d9a15 is already attached to instances: d0446c67-3992-4af8-9863-0eed6088d0a7 Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:30:44.467466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a2356cab-d4a8-4da6-81da-fc92dc6d9a15 is already attached to instances: d0446c67-3992-4af8-9863-0eed6088d0a7 Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:30:44.468730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:30:44.470075 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:30:44.470075 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:30:44.470075 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:30:44.470075 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a2356cab-d4a8-4da6-81da-fc92dc6d9a15 is already attached to instances: d0446c67-3992-4af8-9863-0eed6088d0a7 Sep 13 03:30:44.470075 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:30:44.470075 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3934affb-99dc-41bd-8a9d-92574c5a2df5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 400 to user: Invalid volume: volume a2356cab-d4a8-4da6-81da-fc92dc6d9a15 is already attached to instances: d0446c67-3992-4af8-9863-0eed6088d0a7 {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:30:44.470075 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3934affb-99dc-41bd-8a9d-92574c5a2df5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114770 Sep 13 03:30:44.470075 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 459/953] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:30:44 2022] POST /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 03:30:44.473673 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-952853a0-6ee7-40b5-ac22-a30a73b8cb5c req-5af76d40-0b65-4156-94b7-11265d647795 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043259 Sep 13 03:30:44.474001 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 495/954] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:30:44.534714 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8bf67006-8ca0-4494-8a90-8bb5d96b0d32 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:44.535726 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8bf67006-8ca0-4494-8a90-8bb5d96b0d32 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:44.541820 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8bf67006-8ca0-4494-8a90-8bb5d96b0d32 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:44.542264 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8bf67006-8ca0-4494-8a90-8bb5d96b0d32 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:44.542724 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8bf67006-8ca0-4494-8a90-8bb5d96b0d32 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:44.543413 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8bf67006-8ca0-4494-8a90-8bb5d96b0d32 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:44.543865 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8bf67006-8ca0-4494-8a90-8bb5d96b0d32 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:44.544287 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8bf67006-8ca0-4494-8a90-8bb5d96b0d32 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:44.623742 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5fc2876f-6e14-4558-98c3-55c11a5f41e4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:44.624300 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-8bf67006-8ca0-4494-8a90-8bb5d96b0d32 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lazy-loading 'services' on Instance uuid d0446c67-3992-4af8-9863-0eed6088d0a7 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:30:44.624752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5fc2876f-6e14-4558-98c3-55c11a5f41e4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:44.630446 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5fc2876f-6e14-4558-98c3-55c11a5f41e4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:44.630968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5fc2876f-6e14-4558-98c3-55c11a5f41e4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:44.631395 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5fc2876f-6e14-4558-98c3-55c11a5f41e4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:44.632320 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5fc2876f-6e14-4558-98c3-55c11a5f41e4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:44.632785 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5fc2876f-6e14-4558-98c3-55c11a5f41e4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:44.633204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5fc2876f-6e14-4558-98c3-55c11a5f41e4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:44.701184 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5fc2876f-6e14-4558-98c3-55c11a5f41e4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:44.701422 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8bf67006-8ca0-4494-8a90-8bb5d96b0d32 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-volume_attachments/a2356cab-d4a8-4da6-81da-fc92dc6d9a15" status: 202 len: 0 microversion: 2.1 time: 0.170605 Sep 13 03:30:44.702005 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 460/955] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 03:30:44 2022] DELETE /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-volume_attachments/a2356cab-d4a8-4da6-81da-fc92dc6d9a15 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:30:44.708836 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:44.711762 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c97c1660-7ae3-4876-a76a-06bea77fbca4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:44.714112 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c97c1660-7ae3-4876-a76a-06bea77fbca4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:44.714908 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5fc2876f-6e14-4558-98c3-55c11a5f41e4 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1220 microversion: 2.1 time: 0.095282 Sep 13 03:30:44.715848 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 496/956] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:44 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:30:44.720598 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c97c1660-7ae3-4876-a76a-06bea77fbca4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:44.721092 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c97c1660-7ae3-4876-a76a-06bea77fbca4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:44.721534 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c97c1660-7ae3-4876-a76a-06bea77fbca4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:44.722236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c97c1660-7ae3-4876-a76a-06bea77fbca4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:44.722849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c97c1660-7ae3-4876-a76a-06bea77fbca4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:44.723734 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c97c1660-7ae3-4876-a76a-06bea77fbca4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:44.728386 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:44.756531 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c97c1660-7ae3-4876-a76a-06bea77fbca4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049948 Sep 13 03:30:44.757103 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 461/957] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:30:44 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:30:44.889569 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-39af48e0-b20f-49b9-9fde-06c8cb78c7e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:44.890194 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-39af48e0-b20f-49b9-9fde-06c8cb78c7e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:44.898243 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-39af48e0-b20f-49b9-9fde-06c8cb78c7e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:44.898811 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-39af48e0-b20f-49b9-9fde-06c8cb78c7e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:44.899277 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-39af48e0-b20f-49b9-9fde-06c8cb78c7e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:44.899974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-39af48e0-b20f-49b9-9fde-06c8cb78c7e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:44.900438 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-39af48e0-b20f-49b9-9fde-06c8cb78c7e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:44.900869 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-39af48e0-b20f-49b9-9fde-06c8cb78c7e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:45.035228 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-39af48e0-b20f-49b9-9fde-06c8cb78c7e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:45.043719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-39af48e0-b20f-49b9-9fde-06c8cb78c7e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1357 microversion: 2.1 time: 0.158225 Sep 13 03:30:45.070573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 497/958] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:44 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:45.737471 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-fe59052a-4b9b-4a96-8599-a845b1d28c87 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:45.739443 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-fe59052a-4b9b-4a96-8599-a845b1d28c87 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:45.747446 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fe59052a-4b9b-4a96-8599-a845b1d28c87 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:45.747978 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fe59052a-4b9b-4a96-8599-a845b1d28c87 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:45.748454 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fe59052a-4b9b-4a96-8599-a845b1d28c87 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:45.749201 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fe59052a-4b9b-4a96-8599-a845b1d28c87 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:45.749651 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fe59052a-4b9b-4a96-8599-a845b1d28c87 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:45.750359 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fe59052a-4b9b-4a96-8599-a845b1d28c87 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:45.769295 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-73f3ca96-6998-45b0-b96c-c872e53b3a0a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:45.771531 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-73f3ca96-6998-45b0-b96c-c872e53b3a0a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:45.778078 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-73f3ca96-6998-45b0-b96c-c872e53b3a0a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:45.778572 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-73f3ca96-6998-45b0-b96c-c872e53b3a0a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:45.779137 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-73f3ca96-6998-45b0-b96c-c872e53b3a0a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:45.779848 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-73f3ca96-6998-45b0-b96c-c872e53b3a0a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:45.780346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-73f3ca96-6998-45b0-b96c-c872e53b3a0a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:45.780796 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-73f3ca96-6998-45b0-b96c-c872e53b3a0a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:45.812917 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-73f3ca96-6998-45b0-b96c-c872e53b3a0a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047428 Sep 13 03:30:45.813522 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 498/959] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:30:45 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:30:45.814295 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-fe59052a-4b9b-4a96-8599-a845b1d28c87 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:45.822481 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-fe59052a-4b9b-4a96-8599-a845b1d28c87 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1382 microversion: 2.1 time: 0.088957 Sep 13 03:30:45.823055 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 462/960] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:45 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1382 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:46.072414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ceead063-2990-4e0d-b0da-c6f2e253efcb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:46.072954 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ceead063-2990-4e0d-b0da-c6f2e253efcb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:46.079072 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ceead063-2990-4e0d-b0da-c6f2e253efcb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.079553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ceead063-2990-4e0d-b0da-c6f2e253efcb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.079989 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ceead063-2990-4e0d-b0da-c6f2e253efcb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.080736 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ceead063-2990-4e0d-b0da-c6f2e253efcb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.081243 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ceead063-2990-4e0d-b0da-c6f2e253efcb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.081672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ceead063-2990-4e0d-b0da-c6f2e253efcb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.401321 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ceead063-2990-4e0d-b0da-c6f2e253efcb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:46.410867 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ceead063-2990-4e0d-b0da-c6f2e253efcb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1548 microversion: 2.1 time: 0.341894 Sep 13 03:30:46.411427 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 499/961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:46 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1548 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:46.434545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-760581c0-33e5-4e83-af83-13a5bcadee6a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:46.435189 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-760581c0-33e5-4e83-af83-13a5bcadee6a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:46.441295 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-760581c0-33e5-4e83-af83-13a5bcadee6a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.442361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-760581c0-33e5-4e83-af83-13a5bcadee6a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.442901 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-760581c0-33e5-4e83-af83-13a5bcadee6a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.443735 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-760581c0-33e5-4e83-af83-13a5bcadee6a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.444559 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-760581c0-33e5-4e83-af83-13a5bcadee6a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.445191 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-760581c0-33e5-4e83-af83-13a5bcadee6a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.576860 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-760581c0-33e5-4e83-af83-13a5bcadee6a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:46.585113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-760581c0-33e5-4e83-af83-13a5bcadee6a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1548 microversion: 2.1 time: 0.154584 Sep 13 03:30:46.585676 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 463/962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:46 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:46.606529 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5e2b1414-e0fb-41dd-886f-8ea5376ca3a9 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:46.611443 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5e2b1414-e0fb-41dd-886f-8ea5376ca3a9 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:46.612106 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5e2b1414-e0fb-41dd-886f-8ea5376ca3a9 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Searching by: {'deleted': False, 'project_id': '35d0f9365a60474590ea1bb78b1654b2'} {{(pid=120383) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 03:30:46.620155 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5e2b1414-e0fb-41dd-886f-8ea5376ca3a9 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.620852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5e2b1414-e0fb-41dd-886f-8ea5376ca3a9 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.621288 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5e2b1414-e0fb-41dd-886f-8ea5376ca3a9 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.622018 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5e2b1414-e0fb-41dd-886f-8ea5376ca3a9 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.622473 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5e2b1414-e0fb-41dd-886f-8ea5376ca3a9 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.622938 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5e2b1414-e0fb-41dd-886f-8ea5376ca3a9 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.690336 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-53aae0e0-7dbb-4785-9a12-58ad43f2a0db tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:46.690962 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-53aae0e0-7dbb-4785-9a12-58ad43f2a0db tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:46.697459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-53aae0e0-7dbb-4785-9a12-58ad43f2a0db tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.698027 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-53aae0e0-7dbb-4785-9a12-58ad43f2a0db tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.698537 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-53aae0e0-7dbb-4785-9a12-58ad43f2a0db tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.699338 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-53aae0e0-7dbb-4785-9a12-58ad43f2a0db tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.699870 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-53aae0e0-7dbb-4785-9a12-58ad43f2a0db tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.700367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-53aae0e0-7dbb-4785-9a12-58ad43f2a0db tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.714028 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.multi_cell_list [None req-5e2b1414-e0fb-41dd-886f-8ea5376ca3a9 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120383) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 03:30:46.723744 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-53aae0e0-7dbb-4785-9a12-58ad43f2a0db tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/ips" status: 200 len: 150 microversion: 2.20 time: 0.037251 Sep 13 03:30:46.724317 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 464/963] 10.222.0.18 () {60 vars in 1289 bytes} [Tue Sep 13 03:30:46 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 03:30:46.812941 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5e2b1414-e0fb-41dd-886f-8ea5376ca3a9 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.210018 Sep 13 03:30:46.813755 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 500/964] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Sep 13 03:30:46 2022] GET /compute/v2.1/servers => generated 341 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:30:46.826029 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2209215d-d304-46d6-9b78-c2c899b5ca5b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:46.826292 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b0cb6236-dadb-4c88-bcf2-154e7575d756 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:46.826815 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2209215d-d304-46d6-9b78-c2c899b5ca5b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:46.830364 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b0cb6236-dadb-4c88-bcf2-154e7575d756 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:46.833041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2209215d-d304-46d6-9b78-c2c899b5ca5b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.834244 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2209215d-d304-46d6-9b78-c2c899b5ca5b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.834872 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2209215d-d304-46d6-9b78-c2c899b5ca5b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.835625 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2209215d-d304-46d6-9b78-c2c899b5ca5b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.836084 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2209215d-d304-46d6-9b78-c2c899b5ca5b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.836503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2209215d-d304-46d6-9b78-c2c899b5ca5b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.840472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b0cb6236-dadb-4c88-bcf2-154e7575d756 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.841219 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b0cb6236-dadb-4c88-bcf2-154e7575d756 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.841656 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b0cb6236-dadb-4c88-bcf2-154e7575d756 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.842604 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b0cb6236-dadb-4c88-bcf2-154e7575d756 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.843581 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b0cb6236-dadb-4c88-bcf2-154e7575d756 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.844077 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b0cb6236-dadb-4c88-bcf2-154e7575d756 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.881695 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b0cb6236-dadb-4c88-bcf2-154e7575d756 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059531 Sep 13 03:30:46.882416 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 465/965] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:30:46 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 03:30:46.891088 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:46.891820 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:46.898499 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.899248 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.899788 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.900593 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.901364 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.901880 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.959066 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:46.959066 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:46.959066 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:46.959066 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lazy-loading 'fault' on Instance uuid aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:30:47.017021 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad4d86f4c8f450986870292477c1182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8fff2dfb49442492296d4c1701abb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:47.024694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-90708c2b-537f-4ce1-abd2-05332f37fb5a tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 200 len: 1341 microversion: 2.1 time: 0.140952 Sep 13 03:30:47.025264 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 466/966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:46 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 1341 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:47.044965 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-40b43153-b282-4ca4-b195-bc604c434e1a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:47.045774 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-40b43153-b282-4ca4-b195-bc604c434e1a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:47.068516 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-40b43153-b282-4ca4-b195-bc604c434e1a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:47.069024 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-40b43153-b282-4ca4-b195-bc604c434e1a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:47.069742 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-40b43153-b282-4ca4-b195-bc604c434e1a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:47.070458 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-40b43153-b282-4ca4-b195-bc604c434e1a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:47.070947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-40b43153-b282-4ca4-b195-bc604c434e1a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:47.071370 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-40b43153-b282-4ca4-b195-bc604c434e1a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:47.082121 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2209215d-d304-46d6-9b78-c2c899b5ca5b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:47.089923 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2209215d-d304-46d6-9b78-c2c899b5ca5b tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1548 microversion: 2.1 time: 0.267876 Sep 13 03:30:47.090494 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 501/967] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:46 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1548 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:47.098387 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-40b43153-b282-4ca4-b195-bc604c434e1a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:30:47.188987 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-40b43153-b282-4ca4-b195-bc604c434e1a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 204 len: 0 microversion: 2.1 time: 0.162083 Sep 13 03:30:47.189595 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 467/968] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:30:47 2022] DELETE /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:30:47.198555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6586bcad-7734-4ed7-b959-8a4d448e2cd8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:47.199242 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6586bcad-7734-4ed7-b959-8a4d448e2cd8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:47.205269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6586bcad-7734-4ed7-b959-8a4d448e2cd8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:47.205761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6586bcad-7734-4ed7-b959-8a4d448e2cd8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:47.206197 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6586bcad-7734-4ed7-b959-8a4d448e2cd8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:47.206974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6586bcad-7734-4ed7-b959-8a4d448e2cd8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:47.207462 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6586bcad-7734-4ed7-b959-8a4d448e2cd8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:47.207886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6586bcad-7734-4ed7-b959-8a4d448e2cd8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:47.341009 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6586bcad-7734-4ed7-b959-8a4d448e2cd8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:47.353959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6586bcad-7734-4ed7-b959-8a4d448e2cd8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1683 microversion: 2.1 time: 0.159250 Sep 13 03:30:47.355095 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 502/969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:47 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:48.049896 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-34bc2265-61d0-470e-8c02-87ffea15492b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:48.050784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-34bc2265-61d0-470e-8c02-87ffea15492b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] [instance: aae88f2e-fe4e-46c6-bf5a-0381e90e26c6] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:48.056898 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-34bc2265-61d0-470e-8c02-87ffea15492b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:48.057421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-34bc2265-61d0-470e-8c02-87ffea15492b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:48.057860 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-34bc2265-61d0-470e-8c02-87ffea15492b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:48.058552 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-34bc2265-61d0-470e-8c02-87ffea15492b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:48.059033 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-34bc2265-61d0-470e-8c02-87ffea15492b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:48.059472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-34bc2265-61d0-470e-8c02-87ffea15492b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:48.073295 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-34bc2265-61d0-470e-8c02-87ffea15492b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] HTTP exception thrown: Instance aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 could not be found. Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-34bc2265-61d0-470e-8c02-87ffea15492b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Request method failure captured: Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 HTTP/1.1 Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_elTbF4zq2cPJx6M7A52jQ8C200lD3MyoMCMQsPqz2blgoDi7JOMgk8Thu_uh4CdrZDJfG8FuYF550M9BkRNEZVRzXWa_FRxhU0FX373KqUFzNQKj9pEVDJpe2cuXgCtpnjKfR0QeoOCvF4mztKqcNv8Ve-ucTbmiDO2JlG_fyETLM Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: fb8fff2dfb49442492296d4c1701abb1 Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-TestShelveInstance-339756243 Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:30:48.074956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:30:48.076569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb8fff2dfb49442492296d4c1701abb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb8fff2dfb49442492296d4c1701abb1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb8fff2dfb49442492296d4c1701abb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb8fff2dfb49442492296d4c1701abb1"}]}] Sep 13 03:30:48.076569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-TestShelveInstance-339756243 Sep 13 03:30:48.076569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: fb8fff2dfb49442492296d4c1701abb1 Sep 13 03:30:48.076569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-TestShelveInstance-339756243 Sep 13 03:30:48.076569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-TestShelveInstance-339756243-project Sep 13 03:30:48.076569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:30:48.076569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:30:48.076569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 7ad4d86f4c8f450986870292477c1182 Sep 13 03:30:48.076569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-TestShelveInstance-339756243-project Sep 13 03:30:48.076569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:30:48.076569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 could not be found. Sep 13 03:30:48.076569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': 'aae88f2e-fe4e-46c6-bf5a-0381e90e26c6'} Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 could not be found. Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:30:48.077478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 could not be found. Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 could not be found. Sep 13 03:30:48.078958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:30:48.080370 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-34bc2265-61d0-470e-8c02-87ffea15492b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Returning 404 to user: Instance aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:30:48.080370 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-34bc2265-61d0-470e-8c02-87ffea15492b tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6" status: 404 len: 111 microversion: 2.1 time: 0.030703 Sep 13 03:30:48.080370 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 468/970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:48 2022] GET /compute/v2.1/servers/aae88f2e-fe4e-46c6-bf5a-0381e90e26c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:30:48.238639 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f15ba482-82dd-4142-bdcd-f795c0cd7d40 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] Calling method '.version_select at 0x7f8935792b80>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:48.270216 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f15ba482-82dd-4142-bdcd-f795c0cd7d40 tempest-TestShelveInstance-339756243 tempest-TestShelveInstance-339756243-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1965801472" status: 202 len: 0 microversion: 2.1 time: 0.034727 Sep 13 03:30:48.270911 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 503/971] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Sep 13 03:30:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1965801472 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 03:30:48.383279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-bf813c41-51af-4b7d-a250-1d1bfcc50ed5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:48.384405 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-bf813c41-51af-4b7d-a250-1d1bfcc50ed5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:48.390806 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bf813c41-51af-4b7d-a250-1d1bfcc50ed5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:48.391301 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bf813c41-51af-4b7d-a250-1d1bfcc50ed5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:48.391739 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bf813c41-51af-4b7d-a250-1d1bfcc50ed5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:48.392456 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bf813c41-51af-4b7d-a250-1d1bfcc50ed5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:48.393035 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bf813c41-51af-4b7d-a250-1d1bfcc50ed5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:48.393466 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bf813c41-51af-4b7d-a250-1d1bfcc50ed5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:48.583018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-bf813c41-51af-4b7d-a250-1d1bfcc50ed5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:48.590694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-bf813c41-51af-4b7d-a250-1d1bfcc50ed5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1683 microversion: 2.1 time: 0.213590 Sep 13 03:30:48.591493 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 469/972] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:48 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1683 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:48.884776 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e76a5b28-f2d1-4d5a-b3f4-9a05a254cff4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:48.885229 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e76a5b28-f2d1-4d5a-b3f4-9a05a254cff4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:48.892157 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e76a5b28-f2d1-4d5a-b3f4-9a05a254cff4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:48.892659 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e76a5b28-f2d1-4d5a-b3f4-9a05a254cff4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:48.893102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e76a5b28-f2d1-4d5a-b3f4-9a05a254cff4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:48.893809 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e76a5b28-f2d1-4d5a-b3f4-9a05a254cff4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:48.894272 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e76a5b28-f2d1-4d5a-b3f4-9a05a254cff4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:48.894788 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e76a5b28-f2d1-4d5a-b3f4-9a05a254cff4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:48.919425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-e76a5b28-f2d1-4d5a-b3f4-9a05a254cff4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lazy-loading 'flavor' on Instance uuid a712d2c4-a489-45e8-941a-13abba66403c {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:30:49.119903 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e76a5b28-f2d1-4d5a-b3f4-9a05a254cff4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "POST /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/action" status: 202 len: 0 microversion: 2.20 time: 0.239094 Sep 13 03:30:49.120582 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 504/973] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Sep 13 03:30:48 2022] POST /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:30:49.128927 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-362f0174-0da5-4388-9dbb-921531d5b370 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:49.129545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-362f0174-0da5-4388-9dbb-921531d5b370 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:49.136051 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-362f0174-0da5-4388-9dbb-921531d5b370 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:49.136482 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-362f0174-0da5-4388-9dbb-921531d5b370 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:49.136916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-362f0174-0da5-4388-9dbb-921531d5b370 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:49.137608 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-362f0174-0da5-4388-9dbb-921531d5b370 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:49.138063 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-362f0174-0da5-4388-9dbb-921531d5b370 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:49.138485 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-362f0174-0da5-4388-9dbb-921531d5b370 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:49.272797 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-362f0174-0da5-4388-9dbb-921531d5b370 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:49.281837 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-362f0174-0da5-4388-9dbb-921531d5b370 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:49.283487 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-362f0174-0da5-4388-9dbb-921531d5b370 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:49.284711 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-362f0174-0da5-4388-9dbb-921531d5b370 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.159663 Sep 13 03:30:49.286293 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 470/974] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:30:49 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:30:49.614874 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c036b991-05a2-4394-a86b-f7a4291f9e67 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:49.615698 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c036b991-05a2-4394-a86b-f7a4291f9e67 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:49.622837 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c036b991-05a2-4394-a86b-f7a4291f9e67 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:49.623567 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c036b991-05a2-4394-a86b-f7a4291f9e67 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:49.624237 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c036b991-05a2-4394-a86b-f7a4291f9e67 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:49.625137 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c036b991-05a2-4394-a86b-f7a4291f9e67 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:49.625868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c036b991-05a2-4394-a86b-f7a4291f9e67 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:49.626501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c036b991-05a2-4394-a86b-f7a4291f9e67 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:49.769387 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e3713e77-3631-49f4-b2e8-764733e6c489 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8b51756-11bd-414e-9df0-3d6add058886"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:49.772601 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e3713e77-3631-49f4-b2e8-764733e6c489 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:49.779833 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e3713e77-3631-49f4-b2e8-764733e6c489 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:49.780361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e3713e77-3631-49f4-b2e8-764733e6c489 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:49.780803 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e3713e77-3631-49f4-b2e8-764733e6c489 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:49.781506 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e3713e77-3631-49f4-b2e8-764733e6c489 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:49.781970 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e3713e77-3631-49f4-b2e8-764733e6c489 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:49.782397 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e3713e77-3631-49f4-b2e8-764733e6c489 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:50.012427 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c036b991-05a2-4394-a86b-f7a4291f9e67 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:50.020753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c036b991-05a2-4394-a86b-f7a4291f9e67 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1683 microversion: 2.1 time: 0.410923 Sep 13 03:30:50.021333 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 505/975] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:49 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1683 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:50.057943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e3713e77-3631-49f4-b2e8-764733e6c489 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "POST /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292819 Sep 13 03:30:50.058849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 471/976] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:30:49 2022] POST /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:30:50.310837 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6a45d689-6910-4ba3-8f5b-f28be53fffc2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:50.311450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6a45d689-6910-4ba3-8f5b-f28be53fffc2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:50.317280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a45d689-6910-4ba3-8f5b-f28be53fffc2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:50.317792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a45d689-6910-4ba3-8f5b-f28be53fffc2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:50.318422 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a45d689-6910-4ba3-8f5b-f28be53fffc2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:50.319273 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a45d689-6910-4ba3-8f5b-f28be53fffc2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:50.319740 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a45d689-6910-4ba3-8f5b-f28be53fffc2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:50.320180 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6a45d689-6910-4ba3-8f5b-f28be53fffc2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:50.618772 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6a45d689-6910-4ba3-8f5b-f28be53fffc2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:50.626830 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6a45d689-6910-4ba3-8f5b-f28be53fffc2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:50.628281 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6a45d689-6910-4ba3-8f5b-f28be53fffc2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:50.629448 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6a45d689-6910-4ba3-8f5b-f28be53fffc2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.322695 Sep 13 03:30:50.630001 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 506/977] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:30:50 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:30:50.997428 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-2f78affe-23e1-47c2-a122-ef523098f26b req-d682b822-d7ca-420f-8627-fc6ebb10a283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0446c67-3992-4af8-9863-0eed6088d0a7", "name": "network-vif-deleted", "tag": "bd04d4b1-89e1-4671-a828-65eb8d1e5eab"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:51.013541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:51.016541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-2f78affe-23e1-47c2-a122-ef523098f26b req-d682b822-d7ca-420f-8627-fc6ebb10a283 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:51.017297 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-2f78affe-23e1-47c2-a122-ef523098f26b req-d682b822-d7ca-420f-8627-fc6ebb10a283 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:51.018116 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-2f78affe-23e1-47c2-a122-ef523098f26b req-d682b822-d7ca-420f-8627-fc6ebb10a283 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:51.035126 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-2f78affe-23e1-47c2-a122-ef523098f26b req-d682b822-d7ca-420f-8627-fc6ebb10a283 service nova] Creating event network-vif-deleted:bd04d4b1-89e1-4671-a828-65eb8d1e5eab for instance d0446c67-3992-4af8-9863-0eed6088d0a7 on hv-cinder-85707 Sep 13 03:30:51.050127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-2f78affe-23e1-47c2-a122-ef523098f26b req-d682b822-d7ca-420f-8627-fc6ebb10a283 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063288 Sep 13 03:30:51.050791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 472/978] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:30:51.074058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-90877a0a-c3af-4360-b404-19c3eca6ef72 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:51.075027 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-90877a0a-c3af-4360-b404-19c3eca6ef72 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:51.085843 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:51.088515 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-90877a0a-c3af-4360-b404-19c3eca6ef72 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:51.089398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-90877a0a-c3af-4360-b404-19c3eca6ef72 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:51.090223 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-90877a0a-c3af-4360-b404-19c3eca6ef72 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:51.091300 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-90877a0a-c3af-4360-b404-19c3eca6ef72 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:51.091987 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-90877a0a-c3af-4360-b404-19c3eca6ef72 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:51.092677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-90877a0a-c3af-4360-b404-19c3eca6ef72 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:51.200868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-90877a0a-c3af-4360-b404-19c3eca6ef72 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:51.225830 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-90877a0a-c3af-4360-b404-19c3eca6ef72 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 200 len: 1326 microversion: 2.1 time: 0.184364 Sep 13 03:30:51.226603 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 507/979] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:51 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 1326 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:51.658753 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9db2c710-e500-47d7-bc2a-9391863d83f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:51.659500 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9db2c710-e500-47d7-bc2a-9391863d83f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:51.667860 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9db2c710-e500-47d7-bc2a-9391863d83f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:51.668620 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9db2c710-e500-47d7-bc2a-9391863d83f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:51.669236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9db2c710-e500-47d7-bc2a-9391863d83f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:51.670174 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9db2c710-e500-47d7-bc2a-9391863d83f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:51.670817 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9db2c710-e500-47d7-bc2a-9391863d83f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:51.672017 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9db2c710-e500-47d7-bc2a-9391863d83f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:51.884336 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9db2c710-e500-47d7-bc2a-9391863d83f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:51.894385 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9db2c710-e500-47d7-bc2a-9391863d83f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:51.896036 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9db2c710-e500-47d7-bc2a-9391863d83f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:51.897610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9db2c710-e500-47d7-bc2a-9391863d83f1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.244343 Sep 13 03:30:51.911237 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 473/980] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:30:51 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:30:52.258280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8f3a1b5e-8797-4672-a258-3591c434fd44 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:52.262856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8f3a1b5e-8797-4672-a258-3591c434fd44 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:52.270963 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8f3a1b5e-8797-4672-a258-3591c434fd44 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:52.271472 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8f3a1b5e-8797-4672-a258-3591c434fd44 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:52.271911 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8f3a1b5e-8797-4672-a258-3591c434fd44 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:52.272627 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8f3a1b5e-8797-4672-a258-3591c434fd44 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:52.273080 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8f3a1b5e-8797-4672-a258-3591c434fd44 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:52.273510 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8f3a1b5e-8797-4672-a258-3591c434fd44 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:52.305200 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-8f3a1b5e-8797-4672-a258-3591c434fd44 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8f3a1b5e-8797-4672-a258-3591c434fd44 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 HTTP/1.1 Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:30:52.306982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:30:52.308553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:30:52.308553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:30:52.308553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:30:52.308553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:30:52.308553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:30:52.308553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:30:52.308553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:30:52.308553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:30:52.308553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:30:52.308553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:30:52.308553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:30:52.308553 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'd0446c67-3992-4af8-9863-0eed6088d0a7'} Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:30:52.309484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:30:52.310952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:30:52.312270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8f3a1b5e-8797-4672-a258-3591c434fd44 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 404 to user: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:30:52.312270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8f3a1b5e-8797-4672-a258-3591c434fd44 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 404 len: 111 microversion: 2.1 time: 0.055812 Sep 13 03:30:52.312270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 508/981] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:52 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:30:52.329340 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7c34d532-0a61-4d4c-806b-271871532fd4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '.version_select at 0x7f89356919d0>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:52.362151 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7c34d532-0a61-4d4c-806b-271871532fd4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1454670344" status: 202 len: 0 microversion: 2.1 time: 0.043940 Sep 13 03:30:52.366901 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 474/982] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Sep 13 03:30:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1454670344 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:30:52.923752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7772c992-629e-4fe4-8c65-e98bfd798178 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:52.924676 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7772c992-629e-4fe4-8c65-e98bfd798178 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:52.931961 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7772c992-629e-4fe4-8c65-e98bfd798178 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:52.932711 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7772c992-629e-4fe4-8c65-e98bfd798178 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:52.933359 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7772c992-629e-4fe4-8c65-e98bfd798178 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:52.934294 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7772c992-629e-4fe4-8c65-e98bfd798178 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:52.934998 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7772c992-629e-4fe4-8c65-e98bfd798178 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:52.935664 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7772c992-629e-4fe4-8c65-e98bfd798178 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:53.178407 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7772c992-629e-4fe4-8c65-e98bfd798178 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:53.188238 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7772c992-629e-4fe4-8c65-e98bfd798178 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:53.189778 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7772c992-629e-4fe4-8c65-e98bfd798178 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:53.191075 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7772c992-629e-4fe4-8c65-e98bfd798178 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.271296 Sep 13 03:30:53.191711 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 509/983] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:30:52 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:30:53.304703 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-55aa9f72-60be-493a-90fc-292186eeab4b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'create', calling method: .version_select at 0x7f8935732ca0>, body: {"keypair": {"name": "tempest-keypair-1948437372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG94K1wzm+dCWTyLBZMJheQwj6nB5NrotYtAfGVKl2IKnUN67zasrkaX107EEfdZQatLIuYupUkFX6xABn0jeKoyeqDT23aEpuoRqmEneBLh8PkAuA1drhPb5iMFsQcd/Q=="}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:53.321499 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-55aa9f72-60be-493a-90fc-292186eeab4b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:30:53.325814 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-55aa9f72-60be-493a-90fc-292186eeab4b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for user 4f76a7c6fe9347b0bea5f701bccb6150 and project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'key_pairs'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:30:53.351737 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-55aa9f72-60be-493a-90fc-292186eeab4b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051646 Sep 13 03:30:53.353026 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 475/984] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 03:30:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:30:54.216761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-36528bcd-7a19-486b-96a4-5de56fc03a80 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:54.217567 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-36528bcd-7a19-486b-96a4-5de56fc03a80 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:54.224482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36528bcd-7a19-486b-96a4-5de56fc03a80 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:54.224982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36528bcd-7a19-486b-96a4-5de56fc03a80 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:54.225653 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36528bcd-7a19-486b-96a4-5de56fc03a80 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:54.226373 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36528bcd-7a19-486b-96a4-5de56fc03a80 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:54.226862 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36528bcd-7a19-486b-96a4-5de56fc03a80 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:54.227289 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36528bcd-7a19-486b-96a4-5de56fc03a80 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:54.540282 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-36528bcd-7a19-486b-96a4-5de56fc03a80 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:54.551295 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-36528bcd-7a19-486b-96a4-5de56fc03a80 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:54.553592 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-36528bcd-7a19-486b-96a4-5de56fc03a80 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:54.554816 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-36528bcd-7a19-486b-96a4-5de56fc03a80 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.341964 Sep 13 03:30:54.566742 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 510/985] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:30:54 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:30:54.742179 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-856105927", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36a6ffba-7b10-4536-9b6f-36478b4a6ccb"}], "security_groups": [{"name": "tempest-securitygroup--1756991317"}], "key_name": "tempest-keypair-1948437372", "user_data": "}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:54.873152 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.network.neutron [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] validate_networks() for [('36a6ffba-7b10-4536-9b6f-36478b4a6ccb', None, None, None, None, None)] {{(pid=120384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:30:55.556316 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Flavor limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:30:55.557037 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Image limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:30:55.557771 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Flavor pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:30:55.558465 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Image pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:30:55.559126 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:30:55.577471 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:55.578172 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:55.578887 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:55.579835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:55.580445 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:55.581022 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:55.581557 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8bf43f2c-81c6-43fd-a1ca-26a7e59c3a02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:55.583045 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8bf43f2c-81c6-43fd-a1ca-26a7e59c3a02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:55.592914 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8bf43f2c-81c6-43fd-a1ca-26a7e59c3a02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:55.593506 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8bf43f2c-81c6-43fd-a1ca-26a7e59c3a02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:55.595168 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8bf43f2c-81c6-43fd-a1ca-26a7e59c3a02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:55.596000 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8bf43f2c-81c6-43fd-a1ca-26a7e59c3a02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:55.596724 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8bf43f2c-81c6-43fd-a1ca-26a7e59c3a02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:55.597235 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8bf43f2c-81c6-43fd-a1ca-26a7e59c3a02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:55.601457 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:30:55.605685 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Getting quotas for user 4f76a7c6fe9347b0bea5f701bccb6150 and project 676c9aac6fa348b89a2d5cef106f1a74. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:30:55.625921 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Going to run 1 instances... {{(pid=120384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:30:55.628495 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:30:55.679963 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d5f256c9-7dd7-4072-9ab6-ea9a4c38f290 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.943305 Sep 13 03:30:55.681190 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 476/986] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:30:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:30:55.692214 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b28a4b95-0de0-413e-8ec4-2095fd87c65e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:55.693094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b28a4b95-0de0-413e-8ec4-2095fd87c65e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:55.764619 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-8bf43f2c-81c6-43fd-a1ca-26a7e59c3a02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:55.766638 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b28a4b95-0de0-413e-8ec4-2095fd87c65e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:55.779102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-8bf43f2c-81c6-43fd-a1ca-26a7e59c3a02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:55.779494 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b28a4b95-0de0-413e-8ec4-2095fd87c65e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1241 microversion: 2.1 time: 0.091511 Sep 13 03:30:55.780032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 477/987] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:55 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:30:55.786742 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-8bf43f2c-81c6-43fd-a1ca-26a7e59c3a02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:55.786742 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8bf43f2c-81c6-43fd-a1ca-26a7e59c3a02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.204631 Sep 13 03:30:55.795678 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 511/988] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:30:55 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:30:56.805659 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2bcaec6c-6f90-4dfc-b03e-c0b460e22a2f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:56.806303 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2bcaec6c-6f90-4dfc-b03e-c0b460e22a2f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:56.810599 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f2c5026e-d58b-48d9-b526-5127c30b64cc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:56.811240 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f2c5026e-d58b-48d9-b526-5127c30b64cc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:56.813003 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2bcaec6c-6f90-4dfc-b03e-c0b460e22a2f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:56.813490 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2bcaec6c-6f90-4dfc-b03e-c0b460e22a2f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:56.813653 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:56.814289 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2bcaec6c-6f90-4dfc-b03e-c0b460e22a2f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:56.815068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2bcaec6c-6f90-4dfc-b03e-c0b460e22a2f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:56.815474 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2bcaec6c-6f90-4dfc-b03e-c0b460e22a2f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:56.815897 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2bcaec6c-6f90-4dfc-b03e-c0b460e22a2f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:56.819468 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2c5026e-d58b-48d9-b526-5127c30b64cc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:56.819961 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2c5026e-d58b-48d9-b526-5127c30b64cc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:56.820617 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2c5026e-d58b-48d9-b526-5127c30b64cc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:56.821319 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2c5026e-d58b-48d9-b526-5127c30b64cc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:56.821987 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2c5026e-d58b-48d9-b526-5127c30b64cc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:56.822831 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2c5026e-d58b-48d9-b526-5127c30b64cc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:56.883788 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2bcaec6c-6f90-4dfc-b03e-c0b460e22a2f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:56.891536 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2bcaec6c-6f90-4dfc-b03e-c0b460e22a2f tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1237 microversion: 2.1 time: 0.089738 Sep 13 03:30:56.892196 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 478/989] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:56 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:57.013242 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f2c5026e-d58b-48d9-b526-5127c30b64cc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:57.016753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:57.024249 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f2c5026e-d58b-48d9-b526-5127c30b64cc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:57.025630 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f2c5026e-d58b-48d9-b526-5127c30b64cc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:57.027215 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f2c5026e-d58b-48d9-b526-5127c30b64cc tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.220600 Sep 13 03:30:57.028101 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 512/990] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:30:56 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:30:57.822782 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5f5e0e48-e086-42ef-ac42-c8b77b68cbed tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:57.823597 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5f5e0e48-e086-42ef-ac42-c8b77b68cbed tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:57.832882 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f5e0e48-e086-42ef-ac42-c8b77b68cbed tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:57.834423 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f5e0e48-e086-42ef-ac42-c8b77b68cbed tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:57.834920 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f5e0e48-e086-42ef-ac42-c8b77b68cbed tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:57.835663 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f5e0e48-e086-42ef-ac42-c8b77b68cbed tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:57.836131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f5e0e48-e086-42ef-ac42-c8b77b68cbed tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:57.836565 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f5e0e48-e086-42ef-ac42-c8b77b68cbed tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:57.918378 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3b318dce-6092-42d6-b79d-bc80821a2835 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:57.919926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3b318dce-6092-42d6-b79d-bc80821a2835 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:57.932645 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3b318dce-6092-42d6-b79d-bc80821a2835 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:57.934056 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3b318dce-6092-42d6-b79d-bc80821a2835 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:57.935452 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3b318dce-6092-42d6-b79d-bc80821a2835 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:57.936809 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3b318dce-6092-42d6-b79d-bc80821a2835 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:57.937524 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3b318dce-6092-42d6-b79d-bc80821a2835 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:57.938331 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3b318dce-6092-42d6-b79d-bc80821a2835 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:58.028933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3b318dce-6092-42d6-b79d-bc80821a2835 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:58.040479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3b318dce-6092-42d6-b79d-bc80821a2835 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1311 microversion: 2.1 time: 0.128274 Sep 13 03:30:58.041009 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 513/991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:57 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:58.042987 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5f5e0e48-e086-42ef-ac42-c8b77b68cbed tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:58.047162 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:58.058999 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5f5e0e48-e086-42ef-ac42-c8b77b68cbed tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1594 microversion: 2.1 time: 0.240414 Sep 13 03:30:58.060542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 479/992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:57 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1594 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:58.364025 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c52842ef-fe86-41c7-aa63-862901da7ada tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:58.364644 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c52842ef-fe86-41c7-aa63-862901da7ada tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:58.370877 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c52842ef-fe86-41c7-aa63-862901da7ada tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:58.371376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c52842ef-fe86-41c7-aa63-862901da7ada tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:58.371810 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c52842ef-fe86-41c7-aa63-862901da7ada tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:58.372516 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c52842ef-fe86-41c7-aa63-862901da7ada tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:58.372973 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c52842ef-fe86-41c7-aa63-862901da7ada tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:58.373398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c52842ef-fe86-41c7-aa63-862901da7ada tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:58.614586 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c52842ef-fe86-41c7-aa63-862901da7ada tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:58.623095 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c52842ef-fe86-41c7-aa63-862901da7ada tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:58.624526 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c52842ef-fe86-41c7-aa63-862901da7ada tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:58.625916 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c52842ef-fe86-41c7-aa63-862901da7ada tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.571673 Sep 13 03:30:58.626473 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 514/993] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:30:58 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:30:59.075394 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6b2b27ae-ae91-497b-a722-ff25f6c6966e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:59.076023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6b2b27ae-ae91-497b-a722-ff25f6c6966e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:59.085395 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6b2b27ae-ae91-497b-a722-ff25f6c6966e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:59.085841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6b2b27ae-ae91-497b-a722-ff25f6c6966e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:59.086505 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6b2b27ae-ae91-497b-a722-ff25f6c6966e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:59.087445 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6b2b27ae-ae91-497b-a722-ff25f6c6966e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:59.087997 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6b2b27ae-ae91-497b-a722-ff25f6c6966e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:59.088624 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6b2b27ae-ae91-497b-a722-ff25f6c6966e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:59.307939 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-6b2b27ae-ae91-497b-a722-ff25f6c6966e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:59.316116 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6b2b27ae-ae91-497b-a722-ff25f6c6966e tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1367 microversion: 2.1 time: 0.250530 Sep 13 03:30:59.316783 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 480/994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:30:59 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:30:59.502269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-6bac0cff-b0af-4d13-819b-ba7cda9b0829 req-350c2404-ca29-4fe9-a9af-a93b80431da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c95dd15-e568-4147-b1ef-6ea16581ed20", "tag": "58571e1d-dcfb-427e-802d-1adfb75720bc"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:30:59.516576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6bac0cff-b0af-4d13-819b-ba7cda9b0829 req-350c2404-ca29-4fe9-a9af-a93b80431da5 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:59.517372 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6bac0cff-b0af-4d13-819b-ba7cda9b0829 req-350c2404-ca29-4fe9-a9af-a93b80431da5 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:59.517835 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-6bac0cff-b0af-4d13-819b-ba7cda9b0829 req-350c2404-ca29-4fe9-a9af-a93b80431da5 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:59.530650 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-6bac0cff-b0af-4d13-819b-ba7cda9b0829 req-350c2404-ca29-4fe9-a9af-a93b80431da5 service nova] Creating event network-changed:58571e1d-dcfb-427e-802d-1adfb75720bc for instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 on hv-cinder-85707 Sep 13 03:30:59.536163 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-6bac0cff-b0af-4d13-819b-ba7cda9b0829 req-350c2404-ca29-4fe9-a9af-a93b80431da5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042709 Sep 13 03:30:59.536772 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 515/995] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:30:59.651850 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-817c73c7-45c1-49cd-b128-7d81aa3e5401 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:30:59.652492 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-817c73c7-45c1-49cd-b128-7d81aa3e5401 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:30:59.658493 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-817c73c7-45c1-49cd-b128-7d81aa3e5401 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:59.659013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-817c73c7-45c1-49cd-b128-7d81aa3e5401 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:59.659448 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-817c73c7-45c1-49cd-b128-7d81aa3e5401 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:59.660808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-817c73c7-45c1-49cd-b128-7d81aa3e5401 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:30:59.661270 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-817c73c7-45c1-49cd-b128-7d81aa3e5401 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:30:59.661695 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-817c73c7-45c1-49cd-b128-7d81aa3e5401 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:30:59.919521 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-817c73c7-45c1-49cd-b128-7d81aa3e5401 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:59.928767 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-817c73c7-45c1-49cd-b128-7d81aa3e5401 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:59.930201 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-817c73c7-45c1-49cd-b128-7d81aa3e5401 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:30:59.931571 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-817c73c7-45c1-49cd-b128-7d81aa3e5401 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.283654 Sep 13 03:30:59.932297 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 481/996] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:30:59 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:00.280658 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-437fe437-6408-480f-900a-59b63575d990 req-da2acf4c-3b77-40e5-bbd3-c1f3a0e5f554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c5c35a-9c3f-4796-a202-214bcff70431", "tag": "fd8213ce-3653-4272-bd22-22e80d1944df"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:31:00.291590 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-437fe437-6408-480f-900a-59b63575d990 req-da2acf4c-3b77-40e5-bbd3-c1f3a0e5f554 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:00.292539 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-437fe437-6408-480f-900a-59b63575d990 req-da2acf4c-3b77-40e5-bbd3-c1f3a0e5f554 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:00.293266 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-437fe437-6408-480f-900a-59b63575d990 req-da2acf4c-3b77-40e5-bbd3-c1f3a0e5f554 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:00.306344 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-437fe437-6408-480f-900a-59b63575d990 req-da2acf4c-3b77-40e5-bbd3-c1f3a0e5f554 service nova] Creating event network-changed:fd8213ce-3653-4272-bd22-22e80d1944df for instance d4c5c35a-9c3f-4796-a202-214bcff70431 on hv-cinder-85707 Sep 13 03:31:00.312598 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-437fe437-6408-480f-900a-59b63575d990 req-da2acf4c-3b77-40e5-bbd3-c1f3a0e5f554 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036258 Sep 13 03:31:00.314095 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 516/997] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:31:00.339230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-979d5a74-4f69-468f-99d4-e20fb2fe3b60 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:00.339844 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-979d5a74-4f69-468f-99d4-e20fb2fe3b60 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:00.346564 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-979d5a74-4f69-468f-99d4-e20fb2fe3b60 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:00.347081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-979d5a74-4f69-468f-99d4-e20fb2fe3b60 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:00.347827 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-979d5a74-4f69-468f-99d4-e20fb2fe3b60 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:00.348717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-979d5a74-4f69-468f-99d4-e20fb2fe3b60 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:00.349346 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-979d5a74-4f69-468f-99d4-e20fb2fe3b60 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:00.350054 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-979d5a74-4f69-468f-99d4-e20fb2fe3b60 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:00.505273 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-979d5a74-4f69-468f-99d4-e20fb2fe3b60 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:00.513473 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-979d5a74-4f69-468f-99d4-e20fb2fe3b60 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1367 microversion: 2.1 time: 0.178002 Sep 13 03:31:00.523645 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 482/998] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:00 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:31:00.959912 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-05c39070-6a05-4059-8477-681c3c17041a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:00.960753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-05c39070-6a05-4059-8477-681c3c17041a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:00.968924 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05c39070-6a05-4059-8477-681c3c17041a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:00.969685 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05c39070-6a05-4059-8477-681c3c17041a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:00.970155 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05c39070-6a05-4059-8477-681c3c17041a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:00.970937 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05c39070-6a05-4059-8477-681c3c17041a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:00.971464 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05c39070-6a05-4059-8477-681c3c17041a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:00.972767 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-05c39070-6a05-4059-8477-681c3c17041a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:01.161090 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-05c39070-6a05-4059-8477-681c3c17041a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:01.170176 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-05c39070-6a05-4059-8477-681c3c17041a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:01.171669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-05c39070-6a05-4059-8477-681c3c17041a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:01.172848 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-05c39070-6a05-4059-8477-681c3c17041a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.219186 Sep 13 03:31:01.173710 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 517/999] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:00 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:01.332352 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-bc209cbb-c62b-4b55-a303-8a8b0a91085a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1827163671"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:31:01.333041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-bc209cbb-c62b-4b55-a303-8a8b0a91085a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:01.339151 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc209cbb-c62b-4b55-a303-8a8b0a91085a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:01.339732 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc209cbb-c62b-4b55-a303-8a8b0a91085a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:01.340285 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc209cbb-c62b-4b55-a303-8a8b0a91085a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:01.341074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc209cbb-c62b-4b55-a303-8a8b0a91085a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:01.341606 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc209cbb-c62b-4b55-a303-8a8b0a91085a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:01.342105 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc209cbb-c62b-4b55-a303-8a8b0a91085a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:01.481936 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.network.security_group_api [None req-bc209cbb-c62b-4b55-a303-8a8b0a91085a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Adding security group f61ba66a-6468-4582-b17f-fe248aede443 to port fd8213ce-3653-4272-bd22-22e80d1944df Sep 13 03:31:01.536223 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-dd2558eb-47e6-48d4-a386-33c2dc1d2fe7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:01.537824 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-dd2558eb-47e6-48d4-a386-33c2dc1d2fe7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:01.544308 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dd2558eb-47e6-48d4-a386-33c2dc1d2fe7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:01.545144 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dd2558eb-47e6-48d4-a386-33c2dc1d2fe7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:01.545802 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dd2558eb-47e6-48d4-a386-33c2dc1d2fe7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:01.546772 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dd2558eb-47e6-48d4-a386-33c2dc1d2fe7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:01.547469 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dd2558eb-47e6-48d4-a386-33c2dc1d2fe7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:01.548119 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-dd2558eb-47e6-48d4-a386-33c2dc1d2fe7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:01.710332 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-dd2558eb-47e6-48d4-a386-33c2dc1d2fe7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:01.717956 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-dd2558eb-47e6-48d4-a386-33c2dc1d2fe7 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1367 microversion: 2.1 time: 0.185677 Sep 13 03:31:01.718524 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 518/1000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:01 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:31:01.826048 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-bc209cbb-c62b-4b55-a303-8a8b0a91085a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "POST /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/action" status: 202 len: 0 microversion: 2.1 time: 0.499306 Sep 13 03:31:01.827103 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 483/1001] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:31:01 2022] POST /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:31:01.835253 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-36c8f01a-7a38-4d59-90da-e94638774793 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:01.835867 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-36c8f01a-7a38-4d59-90da-e94638774793 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:01.841764 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36c8f01a-7a38-4d59-90da-e94638774793 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:01.842248 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36c8f01a-7a38-4d59-90da-e94638774793 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:01.842917 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36c8f01a-7a38-4d59-90da-e94638774793 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:01.843610 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36c8f01a-7a38-4d59-90da-e94638774793 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:01.844062 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36c8f01a-7a38-4d59-90da-e94638774793 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:01.844483 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-36c8f01a-7a38-4d59-90da-e94638774793 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:01.995924 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-36c8f01a-7a38-4d59-90da-e94638774793 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:02.004664 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-36c8f01a-7a38-4d59-90da-e94638774793 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1641 microversion: 2.1 time: 0.173524 Sep 13 03:31:02.005231 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 519/1002] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:01 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1641 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:31:02.201310 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-adf4dc59-275a-4106-880d-95b37fc43bea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:02.201925 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-adf4dc59-275a-4106-880d-95b37fc43bea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:02.207995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-adf4dc59-275a-4106-880d-95b37fc43bea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:02.208481 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-adf4dc59-275a-4106-880d-95b37fc43bea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:02.208919 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-adf4dc59-275a-4106-880d-95b37fc43bea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:02.209604 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-adf4dc59-275a-4106-880d-95b37fc43bea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:02.210136 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-adf4dc59-275a-4106-880d-95b37fc43bea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:02.210561 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-adf4dc59-275a-4106-880d-95b37fc43bea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:02.332585 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-f97d8498-a079-4d5c-8553-4b293ad6cc4b req-ba2f6082-a8da-40cf-a35f-5dda77de2012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c5c35a-9c3f-4796-a202-214bcff70431", "tag": "fd8213ce-3653-4272-bd22-22e80d1944df"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:31:02.342598 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-f97d8498-a079-4d5c-8553-4b293ad6cc4b req-ba2f6082-a8da-40cf-a35f-5dda77de2012 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:02.343176 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-f97d8498-a079-4d5c-8553-4b293ad6cc4b req-ba2f6082-a8da-40cf-a35f-5dda77de2012 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:02.343707 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-f97d8498-a079-4d5c-8553-4b293ad6cc4b req-ba2f6082-a8da-40cf-a35f-5dda77de2012 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:02.345156 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-adf4dc59-275a-4106-880d-95b37fc43bea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:02.354911 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-adf4dc59-275a-4106-880d-95b37fc43bea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:02.356170 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-f97d8498-a079-4d5c-8553-4b293ad6cc4b req-ba2f6082-a8da-40cf-a35f-5dda77de2012 service nova] Creating event network-changed:fd8213ce-3653-4272-bd22-22e80d1944df for instance d4c5c35a-9c3f-4796-a202-214bcff70431 on hv-cinder-85707 Sep 13 03:31:02.356354 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-adf4dc59-275a-4106-880d-95b37fc43bea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:02.357523 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-adf4dc59-275a-4106-880d-95b37fc43bea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.160183 Sep 13 03:31:02.358071 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 484/1003] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:02 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:02.373003 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-f97d8498-a079-4d5c-8553-4b293ad6cc4b req-ba2f6082-a8da-40cf-a35f-5dda77de2012 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043960 Sep 13 03:31:02.373610 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 520/1004] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:31:02.740727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2501fa1e-9c8d-4d02-ad72-2c138d74fccc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:02.741335 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2501fa1e-9c8d-4d02-ad72-2c138d74fccc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:02.747250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2501fa1e-9c8d-4d02-ad72-2c138d74fccc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:02.747733 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2501fa1e-9c8d-4d02-ad72-2c138d74fccc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:02.748164 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2501fa1e-9c8d-4d02-ad72-2c138d74fccc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:02.748849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2501fa1e-9c8d-4d02-ad72-2c138d74fccc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:02.749360 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2501fa1e-9c8d-4d02-ad72-2c138d74fccc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:02.749722 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2501fa1e-9c8d-4d02-ad72-2c138d74fccc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:02.886381 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2501fa1e-9c8d-4d02-ad72-2c138d74fccc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:02.894526 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2501fa1e-9c8d-4d02-ad72-2c138d74fccc tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1367 microversion: 2.1 time: 0.157118 Sep 13 03:31:02.895145 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 485/1005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:02 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:31:03.385825 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-51d10393-db5c-4376-9a90-711a069a592b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:03.386560 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-51d10393-db5c-4376-9a90-711a069a592b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:03.392734 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-51d10393-db5c-4376-9a90-711a069a592b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:03.393209 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-51d10393-db5c-4376-9a90-711a069a592b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:03.393645 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-51d10393-db5c-4376-9a90-711a069a592b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:03.394352 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-51d10393-db5c-4376-9a90-711a069a592b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:03.394832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-51d10393-db5c-4376-9a90-711a069a592b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:03.395260 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-51d10393-db5c-4376-9a90-711a069a592b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:03.711956 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-51d10393-db5c-4376-9a90-711a069a592b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:03.721352 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-e508a00e-63ab-4aef-8282-0cb281578319 req-339dc256-39b0-4461-96c5-7a72ef5d8289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a712d2c4-a489-45e8-941a-13abba66403c", "name": "network-vif-plugged", "status": "completed", "tag": "1b4bf2a7-2e87-4a14-894c-d018f847fb5b"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:31:03.721861 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-51d10393-db5c-4376-9a90-711a069a592b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:03.723808 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-51d10393-db5c-4376-9a90-711a069a592b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:03.725093 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-51d10393-db5c-4376-9a90-711a069a592b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1742 microversion: 2.20 time: 0.344061 Sep 13 03:31:03.737141 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-e508a00e-63ab-4aef-8282-0cb281578319 req-339dc256-39b0-4461-96c5-7a72ef5d8289 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:03.738738 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-e508a00e-63ab-4aef-8282-0cb281578319 req-339dc256-39b0-4461-96c5-7a72ef5d8289 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:03.740567 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-e508a00e-63ab-4aef-8282-0cb281578319 req-339dc256-39b0-4461-96c5-7a72ef5d8289 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:03.740881 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 521/1006] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:03 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1742 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:03.753114 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-e508a00e-63ab-4aef-8282-0cb281578319 req-339dc256-39b0-4461-96c5-7a72ef5d8289 service nova] Creating event network-vif-plugged:1b4bf2a7-2e87-4a14-894c-d018f847fb5b for instance a712d2c4-a489-45e8-941a-13abba66403c on hv-cinder-85707 Sep 13 03:31:03.759072 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-e508a00e-63ab-4aef-8282-0cb281578319 req-339dc256-39b0-4461-96c5-7a72ef5d8289 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041333 Sep 13 03:31:03.759873 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 486/1007] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:31:03.917148 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-52aff297-06da-4a69-8017-07232cc8305b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:03.917870 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-52aff297-06da-4a69-8017-07232cc8305b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:03.923743 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-52aff297-06da-4a69-8017-07232cc8305b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:03.924228 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-52aff297-06da-4a69-8017-07232cc8305b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:03.924656 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-52aff297-06da-4a69-8017-07232cc8305b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:03.925945 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-52aff297-06da-4a69-8017-07232cc8305b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:03.926399 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-52aff297-06da-4a69-8017-07232cc8305b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:03.926840 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-52aff297-06da-4a69-8017-07232cc8305b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:04.075278 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-52aff297-06da-4a69-8017-07232cc8305b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:04.083518 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-52aff297-06da-4a69-8017-07232cc8305b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1367 microversion: 2.1 time: 0.170474 Sep 13 03:31:04.084106 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 522/1008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:03 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:31:04.751555 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b164914f-4894-431a-85bc-47bad509a35b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:04.752270 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b164914f-4894-431a-85bc-47bad509a35b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:04.759262 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b164914f-4894-431a-85bc-47bad509a35b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:04.759744 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b164914f-4894-431a-85bc-47bad509a35b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:04.760174 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b164914f-4894-431a-85bc-47bad509a35b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:04.760849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b164914f-4894-431a-85bc-47bad509a35b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:04.761297 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b164914f-4894-431a-85bc-47bad509a35b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:04.761712 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b164914f-4894-431a-85bc-47bad509a35b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:04.887497 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b164914f-4894-431a-85bc-47bad509a35b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:04.895423 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b164914f-4894-431a-85bc-47bad509a35b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:04.896847 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b164914f-4894-431a-85bc-47bad509a35b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:04.897996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b164914f-4894-431a-85bc-47bad509a35b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1742 microversion: 2.20 time: 0.150748 Sep 13 03:31:04.898542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 487/1009] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:04 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:05.106693 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d1817d87-6dd0-408e-8ed9-7221608e4959 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:05.107242 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d1817d87-6dd0-408e-8ed9-7221608e4959 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:05.114101 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1817d87-6dd0-408e-8ed9-7221608e4959 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:05.114588 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1817d87-6dd0-408e-8ed9-7221608e4959 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:05.115051 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1817d87-6dd0-408e-8ed9-7221608e4959 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:05.115733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1817d87-6dd0-408e-8ed9-7221608e4959 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:05.116189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1817d87-6dd0-408e-8ed9-7221608e4959 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:05.116616 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1817d87-6dd0-408e-8ed9-7221608e4959 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:05.247901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d1817d87-6dd0-408e-8ed9-7221608e4959 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:05.255635 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d1817d87-6dd0-408e-8ed9-7221608e4959 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1367 microversion: 2.1 time: 0.152832 Sep 13 03:31:05.256884 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 523/1010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:05 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:31:05.854600 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-aca1a1df-def6-42ce-9580-452f0e542ca2 req-03d6e54b-1c9a-47d9-b124-fbd883f2eaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c95dd15-e568-4147-b1ef-6ea16581ed20", "name": "network-vif-plugged", "status": "completed", "tag": "58571e1d-dcfb-427e-802d-1adfb75720bc"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:31:05.860125 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:05.861433 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=12 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:05.868956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-aca1a1df-def6-42ce-9580-452f0e542ca2 req-03d6e54b-1c9a-47d9-b124-fbd883f2eaf4 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:05.869471 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-aca1a1df-def6-42ce-9580-452f0e542ca2 req-03d6e54b-1c9a-47d9-b124-fbd883f2eaf4 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:05.869965 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-aca1a1df-def6-42ce-9580-452f0e542ca2 req-03d6e54b-1c9a-47d9-b124-fbd883f2eaf4 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:05.881437 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-aca1a1df-def6-42ce-9580-452f0e542ca2 req-03d6e54b-1c9a-47d9-b124-fbd883f2eaf4 service nova] Creating event network-vif-plugged:58571e1d-dcfb-427e-802d-1adfb75720bc for instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 on hv-cinder-85707 Sep 13 03:31:05.886446 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-aca1a1df-def6-42ce-9580-452f0e542ca2 req-03d6e54b-1c9a-47d9-b124-fbd883f2eaf4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035802 Sep 13 03:31:05.887047 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 488/1011] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:31:05.923268 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7a364368-6c8a-4de5-9c8e-fd85bd7ae0b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:05.923906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7a364368-6c8a-4de5-9c8e-fd85bd7ae0b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:05.929945 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a364368-6c8a-4de5-9c8e-fd85bd7ae0b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:05.930433 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a364368-6c8a-4de5-9c8e-fd85bd7ae0b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:05.930904 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a364368-6c8a-4de5-9c8e-fd85bd7ae0b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:05.931599 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a364368-6c8a-4de5-9c8e-fd85bd7ae0b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:05.932056 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a364368-6c8a-4de5-9c8e-fd85bd7ae0b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:05.932481 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a364368-6c8a-4de5-9c8e-fd85bd7ae0b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:06.077257 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7a364368-6c8a-4de5-9c8e-fd85bd7ae0b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:06.088275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7a364368-6c8a-4de5-9c8e-fd85bd7ae0b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:06.089915 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7a364368-6c8a-4de5-9c8e-fd85bd7ae0b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:06.091363 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7a364368-6c8a-4de5-9c8e-fd85bd7ae0b6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1742 microversion: 2.20 time: 0.172123 Sep 13 03:31:06.092090 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 524/1012] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:05 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1742 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:06.279312 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0662d0bb-7b9c-47a4-8bc1-19341554e667 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:06.279946 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0662d0bb-7b9c-47a4-8bc1-19341554e667 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:06.286046 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0662d0bb-7b9c-47a4-8bc1-19341554e667 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:06.286534 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0662d0bb-7b9c-47a4-8bc1-19341554e667 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:06.287005 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0662d0bb-7b9c-47a4-8bc1-19341554e667 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:06.287695 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0662d0bb-7b9c-47a4-8bc1-19341554e667 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:06.288153 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0662d0bb-7b9c-47a4-8bc1-19341554e667 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:06.288834 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0662d0bb-7b9c-47a4-8bc1-19341554e667 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:06.418450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0662d0bb-7b9c-47a4-8bc1-19341554e667 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:06.426716 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0662d0bb-7b9c-47a4-8bc1-19341554e667 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1367 microversion: 2.1 time: 0.151694 Sep 13 03:31:06.427281 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 489/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:06 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:31:07.117448 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c07bb684-c78a-4567-a1f4-f936bbdee991 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:07.118059 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c07bb684-c78a-4567-a1f4-f936bbdee991 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:07.124530 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c07bb684-c78a-4567-a1f4-f936bbdee991 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:07.125023 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c07bb684-c78a-4567-a1f4-f936bbdee991 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:07.125456 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c07bb684-c78a-4567-a1f4-f936bbdee991 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:07.126141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c07bb684-c78a-4567-a1f4-f936bbdee991 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:07.126594 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c07bb684-c78a-4567-a1f4-f936bbdee991 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:07.127042 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c07bb684-c78a-4567-a1f4-f936bbdee991 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:07.254793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c07bb684-c78a-4567-a1f4-f936bbdee991 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:07.262695 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c07bb684-c78a-4567-a1f4-f936bbdee991 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:07.264146 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c07bb684-c78a-4567-a1f4-f936bbdee991 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:07.265321 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c07bb684-c78a-4567-a1f4-f936bbdee991 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1742 microversion: 2.20 time: 0.151739 Sep 13 03:31:07.265870 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 525/1014] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:07 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:07.449227 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-8015ee8b-e6c0-4444-a8bd-b631045d4064 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:07.449839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-8015ee8b-e6c0-4444-a8bd-b631045d4064 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:07.456226 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8015ee8b-e6c0-4444-a8bd-b631045d4064 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:07.456706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8015ee8b-e6c0-4444-a8bd-b631045d4064 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:07.457138 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8015ee8b-e6c0-4444-a8bd-b631045d4064 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:07.457819 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8015ee8b-e6c0-4444-a8bd-b631045d4064 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:07.458270 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8015ee8b-e6c0-4444-a8bd-b631045d4064 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:07.458718 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-8015ee8b-e6c0-4444-a8bd-b631045d4064 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:07.587360 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-8015ee8b-e6c0-4444-a8bd-b631045d4064 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:07.595231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-8015ee8b-e6c0-4444-a8bd-b631045d4064 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1367 microversion: 2.1 time: 0.149845 Sep 13 03:31:07.595787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 490/1015] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:07 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:31:08.290881 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-712cafb0-e8df-4f13-9290-9cad64f3438b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:08.291489 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-712cafb0-e8df-4f13-9290-9cad64f3438b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:08.297728 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-712cafb0-e8df-4f13-9290-9cad64f3438b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:08.298209 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-712cafb0-e8df-4f13-9290-9cad64f3438b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:08.298664 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-712cafb0-e8df-4f13-9290-9cad64f3438b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:08.299348 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-712cafb0-e8df-4f13-9290-9cad64f3438b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:08.299798 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-712cafb0-e8df-4f13-9290-9cad64f3438b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:08.300247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-712cafb0-e8df-4f13-9290-9cad64f3438b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:08.427467 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-712cafb0-e8df-4f13-9290-9cad64f3438b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:08.435479 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-712cafb0-e8df-4f13-9290-9cad64f3438b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:08.436917 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-712cafb0-e8df-4f13-9290-9cad64f3438b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:08.438094 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-712cafb0-e8df-4f13-9290-9cad64f3438b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1742 microversion: 2.20 time: 0.151338 Sep 13 03:31:08.438661 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 526/1016] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:08 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:08.619261 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c5aaed69-7336-4b9c-ad7a-3e79279dd387 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:08.619794 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c5aaed69-7336-4b9c-ad7a-3e79279dd387 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:08.626092 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5aaed69-7336-4b9c-ad7a-3e79279dd387 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:08.626573 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5aaed69-7336-4b9c-ad7a-3e79279dd387 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:08.627044 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5aaed69-7336-4b9c-ad7a-3e79279dd387 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:08.627727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5aaed69-7336-4b9c-ad7a-3e79279dd387 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:08.628176 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5aaed69-7336-4b9c-ad7a-3e79279dd387 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:08.629159 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c5aaed69-7336-4b9c-ad7a-3e79279dd387 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:08.757622 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c5aaed69-7336-4b9c-ad7a-3e79279dd387 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:08.767158 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c5aaed69-7336-4b9c-ad7a-3e79279dd387 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1367 microversion: 2.1 time: 0.151654 Sep 13 03:31:08.767857 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 491/1017] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:08 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:31:09.463520 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-fb05b616-6ffc-4e38-9eb0-fc5007c32501 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:09.464165 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-fb05b616-6ffc-4e38-9eb0-fc5007c32501 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:09.470441 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fb05b616-6ffc-4e38-9eb0-fc5007c32501 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:09.470957 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fb05b616-6ffc-4e38-9eb0-fc5007c32501 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:09.471395 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fb05b616-6ffc-4e38-9eb0-fc5007c32501 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:09.472716 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fb05b616-6ffc-4e38-9eb0-fc5007c32501 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:09.473178 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fb05b616-6ffc-4e38-9eb0-fc5007c32501 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:09.473602 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fb05b616-6ffc-4e38-9eb0-fc5007c32501 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:09.602397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-fb05b616-6ffc-4e38-9eb0-fc5007c32501 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:09.610667 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-fb05b616-6ffc-4e38-9eb0-fc5007c32501 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:09.612091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-fb05b616-6ffc-4e38-9eb0-fc5007c32501 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:09.613292 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-fb05b616-6ffc-4e38-9eb0-fc5007c32501 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1742 microversion: 2.20 time: 0.153669 Sep 13 03:31:09.613839 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 527/1018] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:09 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:09.791311 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0e36912f-d621-49aa-804d-070d40789944 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:09.791830 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0e36912f-d621-49aa-804d-070d40789944 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:09.798134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0e36912f-d621-49aa-804d-070d40789944 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:09.798631 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0e36912f-d621-49aa-804d-070d40789944 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:09.799081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0e36912f-d621-49aa-804d-070d40789944 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:09.799770 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0e36912f-d621-49aa-804d-070d40789944 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:09.800791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0e36912f-d621-49aa-804d-070d40789944 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:09.801215 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0e36912f-d621-49aa-804d-070d40789944 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:09.932014 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0e36912f-d621-49aa-804d-070d40789944 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:09.939917 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0e36912f-d621-49aa-804d-070d40789944 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1558 microversion: 2.1 time: 0.152754 Sep 13 03:31:09.940478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 492/1019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:09 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:31:09.961684 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cef50795-889a-444f-8696-0a4d441f5626 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:09.962180 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-cef50795-889a-444f-8696-0a4d441f5626 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:09.968010 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cef50795-889a-444f-8696-0a4d441f5626 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:09.968495 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cef50795-889a-444f-8696-0a4d441f5626 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:09.968928 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cef50795-889a-444f-8696-0a4d441f5626 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:09.969617 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cef50795-889a-444f-8696-0a4d441f5626 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:09.970074 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cef50795-889a-444f-8696-0a4d441f5626 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:09.970499 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cef50795-889a-444f-8696-0a4d441f5626 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:10.046704 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-cef50795-889a-444f-8696-0a4d441f5626 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088688 Sep 13 03:31:10.047296 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 528/1020] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 03:31:09 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:31:10.639014 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0a9e5baa-62a0-4559-85a7-d7f5cebd50ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:10.639779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0a9e5baa-62a0-4559-85a7-d7f5cebd50ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:10.647137 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a9e5baa-62a0-4559-85a7-d7f5cebd50ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:10.647640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a9e5baa-62a0-4559-85a7-d7f5cebd50ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:10.648081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a9e5baa-62a0-4559-85a7-d7f5cebd50ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:10.648792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a9e5baa-62a0-4559-85a7-d7f5cebd50ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:10.649249 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a9e5baa-62a0-4559-85a7-d7f5cebd50ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:10.649705 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0a9e5baa-62a0-4559-85a7-d7f5cebd50ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:10.779533 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0a9e5baa-62a0-4559-85a7-d7f5cebd50ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:10.789612 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0a9e5baa-62a0-4559-85a7-d7f5cebd50ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:10.792103 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0a9e5baa-62a0-4559-85a7-d7f5cebd50ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:10.792687 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0a9e5baa-62a0-4559-85a7-d7f5cebd50ad tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1742 microversion: 2.20 time: 0.157301 Sep 13 03:31:10.792989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 493/1021] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:10 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:11.255157 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-c478aae0-fedb-4238-a9a6-d7fa18049a24 req-9fb20bc2-abb7-489c-86c9-bc8a918d65ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c95dd15-e568-4147-b1ef-6ea16581ed20", "tag": "58571e1d-dcfb-427e-802d-1adfb75720bc"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:31:11.266675 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-c478aae0-fedb-4238-a9a6-d7fa18049a24 req-9fb20bc2-abb7-489c-86c9-bc8a918d65ab service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:11.267203 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-c478aae0-fedb-4238-a9a6-d7fa18049a24 req-9fb20bc2-abb7-489c-86c9-bc8a918d65ab service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:11.267632 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-c478aae0-fedb-4238-a9a6-d7fa18049a24 req-9fb20bc2-abb7-489c-86c9-bc8a918d65ab service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:11.283175 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-c478aae0-fedb-4238-a9a6-d7fa18049a24 req-9fb20bc2-abb7-489c-86c9-bc8a918d65ab service nova] Creating event network-changed:58571e1d-dcfb-427e-802d-1adfb75720bc for instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 on hv-cinder-85707 Sep 13 03:31:11.289606 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-c478aae0-fedb-4238-a9a6-d7fa18049a24 req-9fb20bc2-abb7-489c-86c9-bc8a918d65ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038681 Sep 13 03:31:11.290454 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 529/1022] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:31:11.821470 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9b5ea378-03c3-42c7-ac4c-2ab8806784a1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:11.822718 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9b5ea378-03c3-42c7-ac4c-2ab8806784a1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:11.830461 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9b5ea378-03c3-42c7-ac4c-2ab8806784a1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:11.832415 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9b5ea378-03c3-42c7-ac4c-2ab8806784a1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:11.833062 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9b5ea378-03c3-42c7-ac4c-2ab8806784a1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:11.834005 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9b5ea378-03c3-42c7-ac4c-2ab8806784a1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:11.834659 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9b5ea378-03c3-42c7-ac4c-2ab8806784a1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:11.835260 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9b5ea378-03c3-42c7-ac4c-2ab8806784a1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:12.025480 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9b5ea378-03c3-42c7-ac4c-2ab8806784a1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:12.034587 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9b5ea378-03c3-42c7-ac4c-2ab8806784a1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:12.036080 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9b5ea378-03c3-42c7-ac4c-2ab8806784a1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:12.037254 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9b5ea378-03c3-42c7-ac4c-2ab8806784a1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1737 microversion: 2.20 time: 0.219644 Sep 13 03:31:12.038333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 494/1023] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:11 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:13.065656 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-939198d7-8d48-43eb-bb9f-3768674cdc6a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:13.066701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-939198d7-8d48-43eb-bb9f-3768674cdc6a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:13.073346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-939198d7-8d48-43eb-bb9f-3768674cdc6a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:13.074097 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-939198d7-8d48-43eb-bb9f-3768674cdc6a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:13.074814 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-939198d7-8d48-43eb-bb9f-3768674cdc6a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:13.075760 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-939198d7-8d48-43eb-bb9f-3768674cdc6a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:13.076427 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-939198d7-8d48-43eb-bb9f-3768674cdc6a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:13.077178 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-939198d7-8d48-43eb-bb9f-3768674cdc6a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:13.223762 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-939198d7-8d48-43eb-bb9f-3768674cdc6a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:13.232243 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-939198d7-8d48-43eb-bb9f-3768674cdc6a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:13.233733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-939198d7-8d48-43eb-bb9f-3768674cdc6a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:13.235132 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-939198d7-8d48-43eb-bb9f-3768674cdc6a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1737 microversion: 2.20 time: 0.174317 Sep 13 03:31:13.235683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 530/1024] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:13 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:14.260328 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-aa6fdae2-d528-4b6f-8ed9-95b1e349b2f0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:14.260933 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-aa6fdae2-d528-4b6f-8ed9-95b1e349b2f0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:14.267373 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aa6fdae2-d528-4b6f-8ed9-95b1e349b2f0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:14.267856 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aa6fdae2-d528-4b6f-8ed9-95b1e349b2f0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:14.268290 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aa6fdae2-d528-4b6f-8ed9-95b1e349b2f0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:14.269045 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aa6fdae2-d528-4b6f-8ed9-95b1e349b2f0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:14.269497 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aa6fdae2-d528-4b6f-8ed9-95b1e349b2f0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:14.269908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-aa6fdae2-d528-4b6f-8ed9-95b1e349b2f0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:14.401666 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-aa6fdae2-d528-4b6f-8ed9-95b1e349b2f0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:14.410803 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-aa6fdae2-d528-4b6f-8ed9-95b1e349b2f0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:14.412261 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-aa6fdae2-d528-4b6f-8ed9-95b1e349b2f0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:14.413682 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-aa6fdae2-d528-4b6f-8ed9-95b1e349b2f0 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1737 microversion: 2.20 time: 0.157245 Sep 13 03:31:14.414289 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 495/1025] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:14 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:15.319359 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-54b0e1af-a4de-41fa-80a4-bc07755e24d3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:15.320095 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-54b0e1af-a4de-41fa-80a4-bc07755e24d3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:15.327454 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54b0e1af-a4de-41fa-80a4-bc07755e24d3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:15.329578 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54b0e1af-a4de-41fa-80a4-bc07755e24d3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:15.330025 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54b0e1af-a4de-41fa-80a4-bc07755e24d3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:15.331070 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54b0e1af-a4de-41fa-80a4-bc07755e24d3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:15.331545 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54b0e1af-a4de-41fa-80a4-bc07755e24d3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:15.331977 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54b0e1af-a4de-41fa-80a4-bc07755e24d3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:15.358113 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-54b0e1af-a4de-41fa-80a4-bc07755e24d3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/ips" status: 200 len: 146 microversion: 2.1 time: 0.191570 Sep 13 03:31:15.373047 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 531/1026] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 03:31:15 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/ips => generated 146 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:31:15.439116 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-adac368e-ae3f-4655-a57f-ab6d6d7c3681 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:15.439909 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-adac368e-ae3f-4655-a57f-ab6d6d7c3681 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:15.447189 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-adac368e-ae3f-4655-a57f-ab6d6d7c3681 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:15.447687 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-adac368e-ae3f-4655-a57f-ab6d6d7c3681 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:15.448123 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-adac368e-ae3f-4655-a57f-ab6d6d7c3681 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:15.448826 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-adac368e-ae3f-4655-a57f-ab6d6d7c3681 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:15.449446 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-adac368e-ae3f-4655-a57f-ab6d6d7c3681 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:15.449872 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-adac368e-ae3f-4655-a57f-ab6d6d7c3681 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:15.617485 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-adac368e-ae3f-4655-a57f-ab6d6d7c3681 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:15.628994 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-adac368e-ae3f-4655-a57f-ab6d6d7c3681 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:15.632013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-adac368e-ae3f-4655-a57f-ab6d6d7c3681 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:15.634272 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-adac368e-ae3f-4655-a57f-ab6d6d7c3681 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1737 microversion: 2.20 time: 0.199484 Sep 13 03:31:15.635211 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 496/1027] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:15 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:16.660599 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-baef61da-aa08-42ce-9dd9-ccb9bf642af9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:16.661214 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-baef61da-aa08-42ce-9dd9-ccb9bf642af9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:16.668395 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-baef61da-aa08-42ce-9dd9-ccb9bf642af9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:16.668874 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-baef61da-aa08-42ce-9dd9-ccb9bf642af9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:16.669303 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-baef61da-aa08-42ce-9dd9-ccb9bf642af9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:16.670195 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-baef61da-aa08-42ce-9dd9-ccb9bf642af9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:16.670791 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-baef61da-aa08-42ce-9dd9-ccb9bf642af9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:16.671208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-baef61da-aa08-42ce-9dd9-ccb9bf642af9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:16.815036 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-baef61da-aa08-42ce-9dd9-ccb9bf642af9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:16.821764 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:16.825110 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e07bef4e-7a9e-43cd-8121-352563f9c713 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c5dfd87-934b-49b4-837b-14b4c411b0c4"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:31:16.827634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e07bef4e-7a9e-43cd-8121-352563f9c713 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:16.827955 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-baef61da-aa08-42ce-9dd9-ccb9bf642af9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:16.829476 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-baef61da-aa08-42ce-9dd9-ccb9bf642af9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:16.830731 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-baef61da-aa08-42ce-9dd9-ccb9bf642af9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1737 microversion: 2.20 time: 0.174550 Sep 13 03:31:16.831285 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 532/1028] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:16 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:16.835233 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e07bef4e-7a9e-43cd-8121-352563f9c713 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:16.835735 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e07bef4e-7a9e-43cd-8121-352563f9c713 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:16.836172 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e07bef4e-7a9e-43cd-8121-352563f9c713 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:16.836865 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e07bef4e-7a9e-43cd-8121-352563f9c713 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:16.837500 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e07bef4e-7a9e-43cd-8121-352563f9c713 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:16.837929 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e07bef4e-7a9e-43cd-8121-352563f9c713 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:16.996506 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:17.119363 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e07bef4e-7a9e-43cd-8121-352563f9c713 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "POST /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298224 Sep 13 03:31:17.120456 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 497/1029] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:31:16 2022] POST /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:31:17.859015 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9c82b657-304b-4c90-8de1-980233e7d635 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:17.860385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9c82b657-304b-4c90-8de1-980233e7d635 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:17.868893 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9c82b657-304b-4c90-8de1-980233e7d635 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:17.869651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9c82b657-304b-4c90-8de1-980233e7d635 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:17.870325 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9c82b657-304b-4c90-8de1-980233e7d635 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:17.871264 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9c82b657-304b-4c90-8de1-980233e7d635 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:17.871792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9c82b657-304b-4c90-8de1-980233e7d635 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:17.872327 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9c82b657-304b-4c90-8de1-980233e7d635 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:18.013503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9c82b657-304b-4c90-8de1-980233e7d635 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:18.022780 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9c82b657-304b-4c90-8de1-980233e7d635 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:18.025390 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9c82b657-304b-4c90-8de1-980233e7d635 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:18.026906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9c82b657-304b-4c90-8de1-980233e7d635 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1737 microversion: 2.20 time: 0.171864 Sep 13 03:31:18.028182 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 533/1030] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:17 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:19.055032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-859198c3-b76b-4026-a0c1-cd3b51da9a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:19.056506 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-859198c3-b76b-4026-a0c1-cd3b51da9a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:19.063055 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-859198c3-b76b-4026-a0c1-cd3b51da9a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:19.063791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-859198c3-b76b-4026-a0c1-cd3b51da9a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:19.064231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-859198c3-b76b-4026-a0c1-cd3b51da9a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:19.064927 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-859198c3-b76b-4026-a0c1-cd3b51da9a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:19.065378 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-859198c3-b76b-4026-a0c1-cd3b51da9a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:19.066029 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-859198c3-b76b-4026-a0c1-cd3b51da9a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:19.438545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-859198c3-b76b-4026-a0c1-cd3b51da9a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:19.447753 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-859198c3-b76b-4026-a0c1-cd3b51da9a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:19.449462 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-859198c3-b76b-4026-a0c1-cd3b51da9a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:19.450994 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-859198c3-b76b-4026-a0c1-cd3b51da9a6f tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1737 microversion: 2.20 time: 0.401415 Sep 13 03:31:19.451799 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 498/1031] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:19 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1737 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:20.484657 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-226f00bb-276a-4e8e-bb12-00b80210363c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:20.491990 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-226f00bb-276a-4e8e-bb12-00b80210363c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:20.505757 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-226f00bb-276a-4e8e-bb12-00b80210363c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:20.506636 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-226f00bb-276a-4e8e-bb12-00b80210363c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:20.507306 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-226f00bb-276a-4e8e-bb12-00b80210363c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:20.508296 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-226f00bb-276a-4e8e-bb12-00b80210363c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:20.508868 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-226f00bb-276a-4e8e-bb12-00b80210363c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:20.509543 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-226f00bb-276a-4e8e-bb12-00b80210363c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:20.650237 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-226f00bb-276a-4e8e-bb12-00b80210363c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:20.659443 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-226f00bb-276a-4e8e-bb12-00b80210363c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:20.661867 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-226f00bb-276a-4e8e-bb12-00b80210363c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:20.663156 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-226f00bb-276a-4e8e-bb12-00b80210363c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1737 microversion: 2.20 time: 0.189581 Sep 13 03:31:20.664201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 534/1032] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:20 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:21.693211 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a19d2abd-508d-4c0d-bba6-4f065fd07e55 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:21.693981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a19d2abd-508d-4c0d-bba6-4f065fd07e55 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:21.700735 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a19d2abd-508d-4c0d-bba6-4f065fd07e55 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:21.701460 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a19d2abd-508d-4c0d-bba6-4f065fd07e55 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:21.701898 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a19d2abd-508d-4c0d-bba6-4f065fd07e55 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:21.702601 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a19d2abd-508d-4c0d-bba6-4f065fd07e55 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:21.703077 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a19d2abd-508d-4c0d-bba6-4f065fd07e55 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:21.703498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a19d2abd-508d-4c0d-bba6-4f065fd07e55 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:21.842487 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a19d2abd-508d-4c0d-bba6-4f065fd07e55 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:21.852227 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a19d2abd-508d-4c0d-bba6-4f065fd07e55 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:21.853691 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a19d2abd-508d-4c0d-bba6-4f065fd07e55 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:21.854907 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a19d2abd-508d-4c0d-bba6-4f065fd07e55 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1737 microversion: 2.20 time: 0.167540 Sep 13 03:31:21.855467 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 499/1033] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:21 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:22.880936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-813c356f-d77a-452e-9c8f-8847be219996 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:22.882324 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-813c356f-d77a-452e-9c8f-8847be219996 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:22.884886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=56 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:22.890365 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-813c356f-d77a-452e-9c8f-8847be219996 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:22.891218 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-813c356f-d77a-452e-9c8f-8847be219996 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:22.891746 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-813c356f-d77a-452e-9c8f-8847be219996 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:22.892681 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-813c356f-d77a-452e-9c8f-8847be219996 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:22.893982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-813c356f-d77a-452e-9c8f-8847be219996 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:22.894641 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-813c356f-d77a-452e-9c8f-8847be219996 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:23.043037 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-813c356f-d77a-452e-9c8f-8847be219996 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:23.052123 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-813c356f-d77a-452e-9c8f-8847be219996 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:23.053709 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-813c356f-d77a-452e-9c8f-8847be219996 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:23.055132 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-813c356f-d77a-452e-9c8f-8847be219996 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1737 microversion: 2.20 time: 0.178574 Sep 13 03:31:23.055799 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 535/1034] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:22 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:24.081314 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3cadf6b0-e20a-4976-9f02-9d84dc92045b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:24.081957 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3cadf6b0-e20a-4976-9f02-9d84dc92045b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:24.084940 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:24.090503 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3cadf6b0-e20a-4976-9f02-9d84dc92045b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:24.091012 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3cadf6b0-e20a-4976-9f02-9d84dc92045b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:24.091443 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3cadf6b0-e20a-4976-9f02-9d84dc92045b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:24.092132 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3cadf6b0-e20a-4976-9f02-9d84dc92045b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:24.092613 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3cadf6b0-e20a-4976-9f02-9d84dc92045b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:24.093033 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3cadf6b0-e20a-4976-9f02-9d84dc92045b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:24.221643 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3cadf6b0-e20a-4976-9f02-9d84dc92045b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:24.229580 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3cadf6b0-e20a-4976-9f02-9d84dc92045b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:24.231041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3cadf6b0-e20a-4976-9f02-9d84dc92045b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:24.232199 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3cadf6b0-e20a-4976-9f02-9d84dc92045b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1737 microversion: 2.20 time: 0.154974 Sep 13 03:31:24.232748 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 500/1035] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:24 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:25.256324 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3d860756-7f0b-4923-89c8-e227afa7a17b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:25.256934 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3d860756-7f0b-4923-89c8-e227afa7a17b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:25.263699 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3d860756-7f0b-4923-89c8-e227afa7a17b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:25.264184 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3d860756-7f0b-4923-89c8-e227afa7a17b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:25.264613 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3d860756-7f0b-4923-89c8-e227afa7a17b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:25.265304 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3d860756-7f0b-4923-89c8-e227afa7a17b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:25.265755 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3d860756-7f0b-4923-89c8-e227afa7a17b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:25.266171 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3d860756-7f0b-4923-89c8-e227afa7a17b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:25.393506 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3d860756-7f0b-4923-89c8-e227afa7a17b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:25.402025 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3d860756-7f0b-4923-89c8-e227afa7a17b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:25.403429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-3d860756-7f0b-4923-89c8-e227afa7a17b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:25.404575 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3d860756-7f0b-4923-89c8-e227afa7a17b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1719 microversion: 2.20 time: 0.152099 Sep 13 03:31:25.405125 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 536/1036] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:25 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:25.759452 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f6a12891-65ab-4d63-b0b6-4e4290e2c80e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:25.761729 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f6a12891-65ab-4d63-b0b6-4e4290e2c80e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:25.768109 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f6a12891-65ab-4d63-b0b6-4e4290e2c80e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:25.768594 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f6a12891-65ab-4d63-b0b6-4e4290e2c80e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:25.769031 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f6a12891-65ab-4d63-b0b6-4e4290e2c80e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:25.769723 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f6a12891-65ab-4d63-b0b6-4e4290e2c80e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:25.770177 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f6a12891-65ab-4d63-b0b6-4e4290e2c80e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:25.771155 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f6a12891-65ab-4d63-b0b6-4e4290e2c80e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:25.800346 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f6a12891-65ab-4d63-b0b6-4e4290e2c80e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045447 Sep 13 03:31:25.800895 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 501/1037] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:31:25 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:31:25.811434 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e7562312-b334-48ce-9aa9-70e20be9e204 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:25.811959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e7562312-b334-48ce-9aa9-70e20be9e204 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:25.817804 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e7562312-b334-48ce-9aa9-70e20be9e204 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:25.818291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e7562312-b334-48ce-9aa9-70e20be9e204 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:25.818775 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e7562312-b334-48ce-9aa9-70e20be9e204 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:25.819464 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e7562312-b334-48ce-9aa9-70e20be9e204 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:25.819923 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e7562312-b334-48ce-9aa9-70e20be9e204 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:25.820341 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e7562312-b334-48ce-9aa9-70e20be9e204 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:25.852128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e7562312-b334-48ce-9aa9-70e20be9e204 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments/0c5dfd87-934b-49b4-837b-14b4c411b0c4" status: 200 len: 194 microversion: 2.1 time: 0.044572 Sep 13 03:31:25.852695 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 537/1038] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Sep 13 03:31:25 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments/0c5dfd87-934b-49b4-837b-14b4c411b0c4 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:31:26.429138 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-0d29ab4d-b903-4af3-8cf2-d1ed7e5518bb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:26.429769 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-0d29ab4d-b903-4af3-8cf2-d1ed7e5518bb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:26.435631 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0d29ab4d-b903-4af3-8cf2-d1ed7e5518bb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:26.436110 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0d29ab4d-b903-4af3-8cf2-d1ed7e5518bb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:26.436541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0d29ab4d-b903-4af3-8cf2-d1ed7e5518bb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:26.437218 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0d29ab4d-b903-4af3-8cf2-d1ed7e5518bb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:26.437666 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0d29ab4d-b903-4af3-8cf2-d1ed7e5518bb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:26.438090 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-0d29ab4d-b903-4af3-8cf2-d1ed7e5518bb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:26.569982 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0d29ab4d-b903-4af3-8cf2-d1ed7e5518bb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:26.577842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0d29ab4d-b903-4af3-8cf2-d1ed7e5518bb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:26.579314 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-0d29ab4d-b903-4af3-8cf2-d1ed7e5518bb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:26.580459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-0d29ab4d-b903-4af3-8cf2-d1ed7e5518bb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1719 microversion: 2.20 time: 0.155288 Sep 13 03:31:26.581005 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 502/1039] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:26 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:27.188456 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-be178fb0-9203-4ed1-8214-7418ac40e733 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d8f7571-0bb8-4af5-9242-fa6b9c6fc729"}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:31:27.191685 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-be178fb0-9203-4ed1-8214-7418ac40e733 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:27.198452 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be178fb0-9203-4ed1-8214-7418ac40e733 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:27.198982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be178fb0-9203-4ed1-8214-7418ac40e733 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:27.199422 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be178fb0-9203-4ed1-8214-7418ac40e733 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:27.200290 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be178fb0-9203-4ed1-8214-7418ac40e733 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:27.200743 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be178fb0-9203-4ed1-8214-7418ac40e733 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:27.201163 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be178fb0-9203-4ed1-8214-7418ac40e733 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:27.506052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-be178fb0-9203-4ed1-8214-7418ac40e733 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "POST /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321433 Sep 13 03:31:27.506676 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 538/1040] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:31:27 2022] POST /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:31:27.605566 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-78f25edd-bf0d-4503-a853-cd7cd3acb8a6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:27.606104 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-78f25edd-bf0d-4503-a853-cd7cd3acb8a6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:27.612508 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78f25edd-bf0d-4503-a853-cd7cd3acb8a6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:27.613023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78f25edd-bf0d-4503-a853-cd7cd3acb8a6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:27.613456 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78f25edd-bf0d-4503-a853-cd7cd3acb8a6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:27.614170 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78f25edd-bf0d-4503-a853-cd7cd3acb8a6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:27.614645 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78f25edd-bf0d-4503-a853-cd7cd3acb8a6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:27.615057 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78f25edd-bf0d-4503-a853-cd7cd3acb8a6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:27.747982 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-78f25edd-bf0d-4503-a853-cd7cd3acb8a6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:27.756557 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-78f25edd-bf0d-4503-a853-cd7cd3acb8a6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:27.757989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-78f25edd-bf0d-4503-a853-cd7cd3acb8a6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:27.759210 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-78f25edd-bf0d-4503-a853-cd7cd3acb8a6 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1722 microversion: 2.20 time: 0.157575 Sep 13 03:31:27.759766 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 503/1041] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:27 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:27.787766 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b7e3ad87-2fbf-422b-ada7-1a3119d5879b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67518166-14b0-4286-b00f-6ba9df742e3b"}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:31:27.790578 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b7e3ad87-2fbf-422b-ada7-1a3119d5879b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:27.796702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b7e3ad87-2fbf-422b-ada7-1a3119d5879b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:27.797192 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b7e3ad87-2fbf-422b-ada7-1a3119d5879b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:27.797633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b7e3ad87-2fbf-422b-ada7-1a3119d5879b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:27.798334 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b7e3ad87-2fbf-422b-ada7-1a3119d5879b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:27.798825 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b7e3ad87-2fbf-422b-ada7-1a3119d5879b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:27.799257 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b7e3ad87-2fbf-422b-ada7-1a3119d5879b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:27.969848 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-f7cc7fc8-a84f-41dd-ab75-73b1f2bb1dae req-ce5885ef-1059-439b-8d21-3861404df7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a712d2c4-a489-45e8-941a-13abba66403c", "name": "network-vif-unplugged", "status": "completed", "tag": "1b4bf2a7-2e87-4a14-894c-d018f847fb5b"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:31:27.982014 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-f7cc7fc8-a84f-41dd-ab75-73b1f2bb1dae req-ce5885ef-1059-439b-8d21-3861404df7bf service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:27.982831 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-f7cc7fc8-a84f-41dd-ab75-73b1f2bb1dae req-ce5885ef-1059-439b-8d21-3861404df7bf service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:27.983279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-f7cc7fc8-a84f-41dd-ab75-73b1f2bb1dae req-ce5885ef-1059-439b-8d21-3861404df7bf service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:27.998905 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.compute.server_external_events [req-f7cc7fc8-a84f-41dd-ab75-73b1f2bb1dae req-ce5885ef-1059-439b-8d21-3861404df7bf service nova] Unable to find a host for instance a712d2c4-a489-45e8-941a-13abba66403c. Dropping event network-vif-unplugged {{(pid=120384) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 03:31:27.999806 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-f7cc7fc8-a84f-41dd-ab75-73b1f2bb1dae req-ce5885ef-1059-439b-8d21-3861404df7bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034085 Sep 13 03:31:28.000408 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 504/1042] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 13 03:31:28.096595 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b7e3ad87-2fbf-422b-ada7-1a3119d5879b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "POST /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313648 Sep 13 03:31:28.097179 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 539/1043] 10.222.0.18 () {62 vars in 1364 bytes} [Tue Sep 13 03:31:27 2022] POST /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/os-volume_attachments => generated 188 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 03:31:28.218784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5de93312-b921-495e-bd92-9321d1dd314e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:28.219280 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5de93312-b921-495e-bd92-9321d1dd314e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:28.225179 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5de93312-b921-495e-bd92-9321d1dd314e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:28.225665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5de93312-b921-495e-bd92-9321d1dd314e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:28.226099 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5de93312-b921-495e-bd92-9321d1dd314e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:28.226827 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5de93312-b921-495e-bd92-9321d1dd314e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:28.227285 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5de93312-b921-495e-bd92-9321d1dd314e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:28.227709 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5de93312-b921-495e-bd92-9321d1dd314e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:28.486596 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5de93312-b921-495e-bd92-9321d1dd314e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/os-volume_attachments/67518166-14b0-4286-b00f-6ba9df742e3b" status: 202 len: 0 microversion: 2.20 time: 0.271791 Sep 13 03:31:28.487246 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 505/1044] 10.222.0.18 () {60 vars in 1457 bytes} [Tue Sep 13 03:31:28 2022] DELETE /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/os-volume_attachments/67518166-14b0-4286-b00f-6ba9df742e3b => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:31:28.550152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-227a026b-a47c-4faf-97f4-57fe96151c9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:31:28.550772 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-227a026b-a47c-4faf-97f4-57fe96151c9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:28.558215 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-227a026b-a47c-4faf-97f4-57fe96151c9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:28.558718 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-227a026b-a47c-4faf-97f4-57fe96151c9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:28.559150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-227a026b-a47c-4faf-97f4-57fe96151c9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:28.559831 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-227a026b-a47c-4faf-97f4-57fe96151c9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:28.560280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-227a026b-a47c-4faf-97f4-57fe96151c9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:28.560698 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-227a026b-a47c-4faf-97f4-57fe96151c9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:28.603150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-227a026b-a47c-4faf-97f4-57fe96151c9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120383) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 03:31:28.668532 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-227a026b-a47c-4faf-97f4-57fe96151c9c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "POST /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/action" status: 202 len: 0 microversion: 2.20 time: 0.122253 Sep 13 03:31:28.669131 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 540/1045] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Sep 13 03:31:28 2022] POST /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:31:28.677703 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-baab09e2-92f7-48e6-8710-38182180ca92 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:28.678472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-baab09e2-92f7-48e6-8710-38182180ca92 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:28.685951 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-baab09e2-92f7-48e6-8710-38182180ca92 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:28.686704 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-baab09e2-92f7-48e6-8710-38182180ca92 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:28.687197 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-baab09e2-92f7-48e6-8710-38182180ca92 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:28.688048 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-baab09e2-92f7-48e6-8710-38182180ca92 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:28.688585 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-baab09e2-92f7-48e6-8710-38182180ca92 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:28.689030 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-baab09e2-92f7-48e6-8710-38182180ca92 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:28.879926 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-baab09e2-92f7-48e6-8710-38182180ca92 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:28.887978 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-baab09e2-92f7-48e6-8710-38182180ca92 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:28.889423 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-baab09e2-92f7-48e6-8710-38182180ca92 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:28.890582 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-baab09e2-92f7-48e6-8710-38182180ca92 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1670 microversion: 2.20 time: 0.217328 Sep 13 03:31:28.891171 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 506/1046] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:28 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1670 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:29.916614 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-411c1d39-1a9b-4f0c-8ad6-bce9e119e39d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:29.917143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-411c1d39-1a9b-4f0c-8ad6-bce9e119e39d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:29.923102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-411c1d39-1a9b-4f0c-8ad6-bce9e119e39d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:29.923584 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-411c1d39-1a9b-4f0c-8ad6-bce9e119e39d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:29.924018 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-411c1d39-1a9b-4f0c-8ad6-bce9e119e39d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:29.924704 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-411c1d39-1a9b-4f0c-8ad6-bce9e119e39d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:29.925155 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-411c1d39-1a9b-4f0c-8ad6-bce9e119e39d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:29.925578 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-411c1d39-1a9b-4f0c-8ad6-bce9e119e39d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:30.086966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-411c1d39-1a9b-4f0c-8ad6-bce9e119e39d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:30.096104 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-411c1d39-1a9b-4f0c-8ad6-bce9e119e39d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:30.097554 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-411c1d39-1a9b-4f0c-8ad6-bce9e119e39d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:30.098830 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-411c1d39-1a9b-4f0c-8ad6-bce9e119e39d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.186813 Sep 13 03:31:30.099362 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 541/1047] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:29 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:31.124408 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ffd1f0e6-e475-4871-b425-214e0a12e7bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:31.125975 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ffd1f0e6-e475-4871-b425-214e0a12e7bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:31.134090 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ffd1f0e6-e475-4871-b425-214e0a12e7bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:31.134848 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ffd1f0e6-e475-4871-b425-214e0a12e7bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:31.135511 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ffd1f0e6-e475-4871-b425-214e0a12e7bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:31.136433 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ffd1f0e6-e475-4871-b425-214e0a12e7bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:31.137111 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ffd1f0e6-e475-4871-b425-214e0a12e7bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:31.137629 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ffd1f0e6-e475-4871-b425-214e0a12e7bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:31.285797 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ffd1f0e6-e475-4871-b425-214e0a12e7bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:31.294752 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ffd1f0e6-e475-4871-b425-214e0a12e7bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:31.296287 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ffd1f0e6-e475-4871-b425-214e0a12e7bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:31.297453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ffd1f0e6-e475-4871-b425-214e0a12e7bd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.177283 Sep 13 03:31:31.298019 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 507/1048] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:31 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:31:32.324183 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0f626f19-3676-4e48-99cd-f59e53adb32b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:32.325456 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0f626f19-3676-4e48-99cd-f59e53adb32b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:32.332003 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f626f19-3676-4e48-99cd-f59e53adb32b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:32.332491 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f626f19-3676-4e48-99cd-f59e53adb32b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:32.333625 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f626f19-3676-4e48-99cd-f59e53adb32b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:32.334320 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f626f19-3676-4e48-99cd-f59e53adb32b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:32.334806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f626f19-3676-4e48-99cd-f59e53adb32b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:32.335228 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0f626f19-3676-4e48-99cd-f59e53adb32b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:32.482539 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0f626f19-3676-4e48-99cd-f59e53adb32b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:32.491698 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0f626f19-3676-4e48-99cd-f59e53adb32b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:32.493146 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0f626f19-3676-4e48-99cd-f59e53adb32b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:32.494297 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0f626f19-3676-4e48-99cd-f59e53adb32b tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.174072 Sep 13 03:31:32.494883 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 542/1049] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:32 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:33.520557 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-caa5614a-384c-4c0a-8092-9e73d6ac2eb9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:33.521167 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-caa5614a-384c-4c0a-8092-9e73d6ac2eb9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:33.527702 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-caa5614a-384c-4c0a-8092-9e73d6ac2eb9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:33.528204 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-caa5614a-384c-4c0a-8092-9e73d6ac2eb9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:33.528641 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-caa5614a-384c-4c0a-8092-9e73d6ac2eb9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:33.529341 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-caa5614a-384c-4c0a-8092-9e73d6ac2eb9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:33.529795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-caa5614a-384c-4c0a-8092-9e73d6ac2eb9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:33.530216 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-caa5614a-384c-4c0a-8092-9e73d6ac2eb9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:33.682361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-caa5614a-384c-4c0a-8092-9e73d6ac2eb9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:33.690952 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-caa5614a-384c-4c0a-8092-9e73d6ac2eb9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:33.692443 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-caa5614a-384c-4c0a-8092-9e73d6ac2eb9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:33.693625 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-caa5614a-384c-4c0a-8092-9e73d6ac2eb9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.176975 Sep 13 03:31:33.706821 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 508/1050] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:33 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:34.718879 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-855b6b96-2496-46b3-86af-2be12f090e7e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:34.719768 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-855b6b96-2496-46b3-86af-2be12f090e7e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:34.726794 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-855b6b96-2496-46b3-86af-2be12f090e7e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:34.727287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-855b6b96-2496-46b3-86af-2be12f090e7e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:34.727725 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-855b6b96-2496-46b3-86af-2be12f090e7e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:34.728548 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-855b6b96-2496-46b3-86af-2be12f090e7e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:34.729012 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-855b6b96-2496-46b3-86af-2be12f090e7e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:34.729575 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-855b6b96-2496-46b3-86af-2be12f090e7e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:34.882391 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-855b6b96-2496-46b3-86af-2be12f090e7e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:34.890960 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-855b6b96-2496-46b3-86af-2be12f090e7e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:34.892410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-855b6b96-2496-46b3-86af-2be12f090e7e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:34.893771 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-855b6b96-2496-46b3-86af-2be12f090e7e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.179522 Sep 13 03:31:34.894341 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 543/1051] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:34 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:35.919988 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f72cdfe2-53d3-4e2e-8319-6b39d287121c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:35.920749 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f72cdfe2-53d3-4e2e-8319-6b39d287121c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:35.928475 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f72cdfe2-53d3-4e2e-8319-6b39d287121c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:35.929054 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f72cdfe2-53d3-4e2e-8319-6b39d287121c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:35.929581 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f72cdfe2-53d3-4e2e-8319-6b39d287121c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:35.930297 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f72cdfe2-53d3-4e2e-8319-6b39d287121c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:35.930791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f72cdfe2-53d3-4e2e-8319-6b39d287121c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:35.931213 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f72cdfe2-53d3-4e2e-8319-6b39d287121c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:36.102271 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f72cdfe2-53d3-4e2e-8319-6b39d287121c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:36.110480 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f72cdfe2-53d3-4e2e-8319-6b39d287121c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:36.111939 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f72cdfe2-53d3-4e2e-8319-6b39d287121c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:36.113102 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f72cdfe2-53d3-4e2e-8319-6b39d287121c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.197141 Sep 13 03:31:36.113864 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 509/1052] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:35 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:37.139236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5cb48068-f27e-418e-a9c4-92c30fe0db02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:37.139965 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5cb48068-f27e-418e-a9c4-92c30fe0db02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:37.147283 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5cb48068-f27e-418e-a9c4-92c30fe0db02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:37.147766 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5cb48068-f27e-418e-a9c4-92c30fe0db02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:37.148196 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5cb48068-f27e-418e-a9c4-92c30fe0db02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:37.148891 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5cb48068-f27e-418e-a9c4-92c30fe0db02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:37.149339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5cb48068-f27e-418e-a9c4-92c30fe0db02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:37.149754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5cb48068-f27e-418e-a9c4-92c30fe0db02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:37.169767 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:37.288823 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5cb48068-f27e-418e-a9c4-92c30fe0db02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:37.297208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5cb48068-f27e-418e-a9c4-92c30fe0db02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:37.298789 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5cb48068-f27e-418e-a9c4-92c30fe0db02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:37.300156 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5cb48068-f27e-418e-a9c4-92c30fe0db02 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.164964 Sep 13 03:31:37.300720 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 544/1053] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:37 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:31:38.326027 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a8e8dc1d-9a4a-47e1-9cd7-e42872b32adb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:38.326782 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a8e8dc1d-9a4a-47e1-9cd7-e42872b32adb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:38.332981 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a8e8dc1d-9a4a-47e1-9cd7-e42872b32adb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:38.333468 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a8e8dc1d-9a4a-47e1-9cd7-e42872b32adb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:38.333909 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a8e8dc1d-9a4a-47e1-9cd7-e42872b32adb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:38.335355 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a8e8dc1d-9a4a-47e1-9cd7-e42872b32adb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:38.335820 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a8e8dc1d-9a4a-47e1-9cd7-e42872b32adb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:38.336246 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a8e8dc1d-9a4a-47e1-9cd7-e42872b32adb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:38.485452 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a8e8dc1d-9a4a-47e1-9cd7-e42872b32adb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:38.494798 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a8e8dc1d-9a4a-47e1-9cd7-e42872b32adb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:38.497204 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a8e8dc1d-9a4a-47e1-9cd7-e42872b32adb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:38.498475 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a8e8dc1d-9a4a-47e1-9cd7-e42872b32adb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.176431 Sep 13 03:31:38.499097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 510/1054] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:38 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:39.524287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9b2fef4f-ab29-42ac-bdee-9f99a7c40a2d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:39.524905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9b2fef4f-ab29-42ac-bdee-9f99a7c40a2d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:39.531482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9b2fef4f-ab29-42ac-bdee-9f99a7c40a2d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:39.531968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9b2fef4f-ab29-42ac-bdee-9f99a7c40a2d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:39.532404 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9b2fef4f-ab29-42ac-bdee-9f99a7c40a2d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:39.533095 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9b2fef4f-ab29-42ac-bdee-9f99a7c40a2d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:39.533565 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9b2fef4f-ab29-42ac-bdee-9f99a7c40a2d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:39.534072 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9b2fef4f-ab29-42ac-bdee-9f99a7c40a2d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:39.678549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9b2fef4f-ab29-42ac-bdee-9f99a7c40a2d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:39.687146 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9b2fef4f-ab29-42ac-bdee-9f99a7c40a2d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:39.688647 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9b2fef4f-ab29-42ac-bdee-9f99a7c40a2d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:39.689834 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9b2fef4f-ab29-42ac-bdee-9f99a7c40a2d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.169948 Sep 13 03:31:39.690420 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 545/1055] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:39 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:40.716811 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5692a492-a054-42f2-b407-05383ad935c8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:40.717455 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5692a492-a054-42f2-b407-05383ad935c8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:40.723959 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5692a492-a054-42f2-b407-05383ad935c8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:40.724443 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5692a492-a054-42f2-b407-05383ad935c8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:40.724877 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5692a492-a054-42f2-b407-05383ad935c8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:40.726219 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5692a492-a054-42f2-b407-05383ad935c8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:40.726704 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5692a492-a054-42f2-b407-05383ad935c8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:40.727130 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5692a492-a054-42f2-b407-05383ad935c8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:40.860082 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5692a492-a054-42f2-b407-05383ad935c8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:40.862243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:40.870291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5692a492-a054-42f2-b407-05383ad935c8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:40.871805 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5692a492-a054-42f2-b407-05383ad935c8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:40.872975 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5692a492-a054-42f2-b407-05383ad935c8 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.160180 Sep 13 03:31:40.873534 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 511/1056] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:40 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:41.896755 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6f3fd4e2-bc55-4e69-b516-a11371ca8c3d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:41.897378 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6f3fd4e2-bc55-4e69-b516-a11371ca8c3d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:41.903822 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f3fd4e2-bc55-4e69-b516-a11371ca8c3d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:41.904302 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f3fd4e2-bc55-4e69-b516-a11371ca8c3d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:41.904731 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f3fd4e2-bc55-4e69-b516-a11371ca8c3d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:41.905409 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f3fd4e2-bc55-4e69-b516-a11371ca8c3d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:41.905937 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f3fd4e2-bc55-4e69-b516-a11371ca8c3d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:41.906365 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f3fd4e2-bc55-4e69-b516-a11371ca8c3d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:42.031708 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6f3fd4e2-bc55-4e69-b516-a11371ca8c3d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:42.040521 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6f3fd4e2-bc55-4e69-b516-a11371ca8c3d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:42.041942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6f3fd4e2-bc55-4e69-b516-a11371ca8c3d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:42.043118 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6f3fd4e2-bc55-4e69-b516-a11371ca8c3d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.150229 Sep 13 03:31:42.043671 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 546/1057] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:41 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:43.068116 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c3a30201-ff85-41c0-84d2-d50b9b62346a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:43.068749 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c3a30201-ff85-41c0-84d2-d50b9b62346a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:43.076515 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c3a30201-ff85-41c0-84d2-d50b9b62346a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:43.077008 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c3a30201-ff85-41c0-84d2-d50b9b62346a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:43.077444 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c3a30201-ff85-41c0-84d2-d50b9b62346a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:43.078140 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c3a30201-ff85-41c0-84d2-d50b9b62346a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:43.078599 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c3a30201-ff85-41c0-84d2-d50b9b62346a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:43.079044 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c3a30201-ff85-41c0-84d2-d50b9b62346a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:43.205184 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c3a30201-ff85-41c0-84d2-d50b9b62346a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:43.213184 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c3a30201-ff85-41c0-84d2-d50b9b62346a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:43.214654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c3a30201-ff85-41c0-84d2-d50b9b62346a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:43.215806 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c3a30201-ff85-41c0-84d2-d50b9b62346a tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.151979 Sep 13 03:31:43.216366 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 512/1058] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:43 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:44.240616 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b1e699c6-e4e4-4a25-ada7-c1c4f7adfc7c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:44.241196 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b1e699c6-e4e4-4a25-ada7-c1c4f7adfc7c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:44.247551 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b1e699c6-e4e4-4a25-ada7-c1c4f7adfc7c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:44.248038 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b1e699c6-e4e4-4a25-ada7-c1c4f7adfc7c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:44.248483 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b1e699c6-e4e4-4a25-ada7-c1c4f7adfc7c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:44.249168 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b1e699c6-e4e4-4a25-ada7-c1c4f7adfc7c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:44.249625 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b1e699c6-e4e4-4a25-ada7-c1c4f7adfc7c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:44.250051 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b1e699c6-e4e4-4a25-ada7-c1c4f7adfc7c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:44.378543 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b1e699c6-e4e4-4a25-ada7-c1c4f7adfc7c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:44.387137 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b1e699c6-e4e4-4a25-ada7-c1c4f7adfc7c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:44.388584 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b1e699c6-e4e4-4a25-ada7-c1c4f7adfc7c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:44.389774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b1e699c6-e4e4-4a25-ada7-c1c4f7adfc7c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.153077 Sep 13 03:31:44.390330 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 547/1059] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:44 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:45.416190 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-66f4e458-7a94-4e95-8ce7-9e195705452c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:45.416728 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-66f4e458-7a94-4e95-8ce7-9e195705452c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:45.423065 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66f4e458-7a94-4e95-8ce7-9e195705452c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:45.423547 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66f4e458-7a94-4e95-8ce7-9e195705452c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:45.423986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66f4e458-7a94-4e95-8ce7-9e195705452c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:45.424664 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66f4e458-7a94-4e95-8ce7-9e195705452c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:45.425112 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66f4e458-7a94-4e95-8ce7-9e195705452c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:45.425529 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-66f4e458-7a94-4e95-8ce7-9e195705452c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:45.554368 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-66f4e458-7a94-4e95-8ce7-9e195705452c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:45.562829 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-66f4e458-7a94-4e95-8ce7-9e195705452c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:45.564315 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-66f4e458-7a94-4e95-8ce7-9e195705452c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:45.565496 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-66f4e458-7a94-4e95-8ce7-9e195705452c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.154080 Sep 13 03:31:45.566036 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 513/1060] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:45 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:46.591067 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9128482b-3ada-4fdd-bdf4-a9e30795f9ba tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:46.591684 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-9128482b-3ada-4fdd-bdf4-a9e30795f9ba tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:46.597926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9128482b-3ada-4fdd-bdf4-a9e30795f9ba tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:46.598412 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9128482b-3ada-4fdd-bdf4-a9e30795f9ba tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:46.598885 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9128482b-3ada-4fdd-bdf4-a9e30795f9ba tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:46.599576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9128482b-3ada-4fdd-bdf4-a9e30795f9ba tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:46.600559 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9128482b-3ada-4fdd-bdf4-a9e30795f9ba tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:46.600985 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-9128482b-3ada-4fdd-bdf4-a9e30795f9ba tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:46.730532 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9128482b-3ada-4fdd-bdf4-a9e30795f9ba tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:46.738498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9128482b-3ada-4fdd-bdf4-a9e30795f9ba tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:46.739943 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-9128482b-3ada-4fdd-bdf4-a9e30795f9ba tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:46.741147 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9128482b-3ada-4fdd-bdf4-a9e30795f9ba tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.153967 Sep 13 03:31:46.741695 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 548/1061] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:46 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:47.765531 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9f9c5402-1184-4b92-859b-99a18804c692 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:47.766133 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9f9c5402-1184-4b92-859b-99a18804c692 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:47.769077 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-49faa411-927d-49e7-811a-610e8f7775d2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:47.771432 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-49faa411-927d-49e7-811a-610e8f7775d2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:47.772716 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9f9c5402-1184-4b92-859b-99a18804c692 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:47.773211 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9f9c5402-1184-4b92-859b-99a18804c692 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:47.773646 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9f9c5402-1184-4b92-859b-99a18804c692 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:47.774340 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9f9c5402-1184-4b92-859b-99a18804c692 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:47.774819 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9f9c5402-1184-4b92-859b-99a18804c692 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:47.775246 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9f9c5402-1184-4b92-859b-99a18804c692 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:47.778125 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-49faa411-927d-49e7-811a-610e8f7775d2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:47.778633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-49faa411-927d-49e7-811a-610e8f7775d2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:47.779136 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-49faa411-927d-49e7-811a-610e8f7775d2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:47.779836 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-49faa411-927d-49e7-811a-610e8f7775d2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:47.780297 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-49faa411-927d-49e7-811a-610e8f7775d2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:47.780722 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-49faa411-927d-49e7-811a-610e8f7775d2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:47.811109 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-49faa411-927d-49e7-811a-610e8f7775d2 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046045 Sep 13 03:31:47.811674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 549/1062] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:31:47 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:31:47.907807 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9f9c5402-1184-4b92-859b-99a18804c692 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:47.916638 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9f9c5402-1184-4b92-859b-99a18804c692 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:47.918086 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9f9c5402-1184-4b92-859b-99a18804c692 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:47.919430 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9f9c5402-1184-4b92-859b-99a18804c692 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.158012 Sep 13 03:31:47.920003 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 514/1063] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:47 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:47.952374 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8b7cabb9-6839-48e5-8a65-9c0e65b1895b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:47.952874 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8b7cabb9-6839-48e5-8a65-9c0e65b1895b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:47.958762 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8b7cabb9-6839-48e5-8a65-9c0e65b1895b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:47.959285 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8b7cabb9-6839-48e5-8a65-9c0e65b1895b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:47.960851 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8b7cabb9-6839-48e5-8a65-9c0e65b1895b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:47.960851 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8b7cabb9-6839-48e5-8a65-9c0e65b1895b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:47.961066 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8b7cabb9-6839-48e5-8a65-9c0e65b1895b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:47.961480 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8b7cabb9-6839-48e5-8a65-9c0e65b1895b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:47.991684 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8b7cabb9-6839-48e5-8a65-9c0e65b1895b tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments/0c5dfd87-934b-49b4-837b-14b4c411b0c4" status: 200 len: 194 microversion: 2.1 time: 0.042802 Sep 13 03:31:47.992288 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 550/1064] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Sep 13 03:31:47 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments/0c5dfd87-934b-49b4-837b-14b4c411b0c4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:31:48.002638 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f16b98c2-2bd2-4858-8804-aaba1fceac1e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:48.003134 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f16b98c2-2bd2-4858-8804-aaba1fceac1e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:48.009608 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f16b98c2-2bd2-4858-8804-aaba1fceac1e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:48.010099 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f16b98c2-2bd2-4858-8804-aaba1fceac1e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:48.010528 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f16b98c2-2bd2-4858-8804-aaba1fceac1e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:48.011249 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f16b98c2-2bd2-4858-8804-aaba1fceac1e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:48.011706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f16b98c2-2bd2-4858-8804-aaba1fceac1e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:48.012132 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f16b98c2-2bd2-4858-8804-aaba1fceac1e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:48.095513 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-f16b98c2-2bd2-4858-8804-aaba1fceac1e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lazy-loading 'services' on Instance uuid 67827f2d-1e40-4e54-83b5-906368c76022 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:31:48.165921 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f16b98c2-2bd2-4858-8804-aaba1fceac1e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "DELETE /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments/0c5dfd87-934b-49b4-837b-14b4c411b0c4" status: 202 len: 0 microversion: 2.1 time: 0.167075 Sep 13 03:31:48.166506 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 515/1065] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 03:31:47 2022] DELETE /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments/0c5dfd87-934b-49b4-837b-14b4c411b0c4 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 03:31:48.945158 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ae30e84c-da4e-41da-a49d-f6094c3fe3dd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:48.945792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ae30e84c-da4e-41da-a49d-f6094c3fe3dd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:48.952051 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae30e84c-da4e-41da-a49d-f6094c3fe3dd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:48.952536 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae30e84c-da4e-41da-a49d-f6094c3fe3dd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:48.952970 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae30e84c-da4e-41da-a49d-f6094c3fe3dd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:48.953657 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae30e84c-da4e-41da-a49d-f6094c3fe3dd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:48.954108 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae30e84c-da4e-41da-a49d-f6094c3fe3dd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:48.954534 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ae30e84c-da4e-41da-a49d-f6094c3fe3dd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:49.082449 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ae30e84c-da4e-41da-a49d-f6094c3fe3dd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:49.090374 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ae30e84c-da4e-41da-a49d-f6094c3fe3dd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:49.091850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ae30e84c-da4e-41da-a49d-f6094c3fe3dd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:49.092999 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ae30e84c-da4e-41da-a49d-f6094c3fe3dd tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.151938 Sep 13 03:31:49.093547 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 551/1066] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:48 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:50.042390 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-fd1dadfb-346a-4e9c-ba55-5a288025084f req-2bc52b9f-1345-4ac6-897c-8cb5f3dd4d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a712d2c4-a489-45e8-941a-13abba66403c", "name": "network-vif-plugged", "status": "completed", "tag": "1b4bf2a7-2e87-4a14-894c-d018f847fb5b"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:31:50.052418 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-fd1dadfb-346a-4e9c-ba55-5a288025084f req-2bc52b9f-1345-4ac6-897c-8cb5f3dd4d46 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:50.052923 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-fd1dadfb-346a-4e9c-ba55-5a288025084f req-2bc52b9f-1345-4ac6-897c-8cb5f3dd4d46 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:50.053393 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-fd1dadfb-346a-4e9c-ba55-5a288025084f req-2bc52b9f-1345-4ac6-897c-8cb5f3dd4d46 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:50.064846 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-fd1dadfb-346a-4e9c-ba55-5a288025084f req-2bc52b9f-1345-4ac6-897c-8cb5f3dd4d46 service nova] Creating event network-vif-plugged:1b4bf2a7-2e87-4a14-894c-d018f847fb5b for instance a712d2c4-a489-45e8-941a-13abba66403c on hv-cinder-85707 Sep 13 03:31:50.070596 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-fd1dadfb-346a-4e9c-ba55-5a288025084f req-2bc52b9f-1345-4ac6-897c-8cb5f3dd4d46 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033727 Sep 13 03:31:50.071367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 516/1067] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:31:50.118454 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5ae60f3b-c8bf-4fd1-b3aa-8aa6c7a47395 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:50.119104 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5ae60f3b-c8bf-4fd1-b3aa-8aa6c7a47395 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:50.126000 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5ae60f3b-c8bf-4fd1-b3aa-8aa6c7a47395 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:50.126476 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5ae60f3b-c8bf-4fd1-b3aa-8aa6c7a47395 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:50.127370 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5ae60f3b-c8bf-4fd1-b3aa-8aa6c7a47395 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:50.128849 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5ae60f3b-c8bf-4fd1-b3aa-8aa6c7a47395 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:50.129322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5ae60f3b-c8bf-4fd1-b3aa-8aa6c7a47395 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:50.129933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5ae60f3b-c8bf-4fd1-b3aa-8aa6c7a47395 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:50.266845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5ae60f3b-c8bf-4fd1-b3aa-8aa6c7a47395 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:50.275757 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5ae60f3b-c8bf-4fd1-b3aa-8aa6c7a47395 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:50.277334 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5ae60f3b-c8bf-4fd1-b3aa-8aa6c7a47395 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:50.278523 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5ae60f3b-c8bf-4fd1-b3aa-8aa6c7a47395 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.164757 Sep 13 03:31:50.279107 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 552/1068] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:50 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:50.350258 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-bb5cf7a0-9f7f-412a-94aa-69ec6329ede4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:50.350939 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-bb5cf7a0-9f7f-412a-94aa-69ec6329ede4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:50.357224 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bb5cf7a0-9f7f-412a-94aa-69ec6329ede4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:50.357714 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bb5cf7a0-9f7f-412a-94aa-69ec6329ede4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:50.358152 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bb5cf7a0-9f7f-412a-94aa-69ec6329ede4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:50.358885 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bb5cf7a0-9f7f-412a-94aa-69ec6329ede4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:50.359517 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bb5cf7a0-9f7f-412a-94aa-69ec6329ede4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:50.359960 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bb5cf7a0-9f7f-412a-94aa-69ec6329ede4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:50.389060 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-bb5cf7a0-9f7f-412a-94aa-69ec6329ede4 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments/3d8f7571-0bb8-4af5-9242-fa6b9c6fc729" status: 200 len: 194 microversion: 2.1 time: 0.043171 Sep 13 03:31:50.389563 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 517/1069] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Sep 13 03:31:50 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments/3d8f7571-0bb8-4af5-9242-fa6b9c6fc729 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:31:50.400604 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-052ae9a9-067e-44f9-b385-bf8ab36b15c9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:50.401093 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-052ae9a9-067e-44f9-b385-bf8ab36b15c9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:50.406857 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-052ae9a9-067e-44f9-b385-bf8ab36b15c9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:50.407340 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-052ae9a9-067e-44f9-b385-bf8ab36b15c9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:50.408102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-052ae9a9-067e-44f9-b385-bf8ab36b15c9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:50.408792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-052ae9a9-067e-44f9-b385-bf8ab36b15c9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:50.409427 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-052ae9a9-067e-44f9-b385-bf8ab36b15c9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:50.409852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-052ae9a9-067e-44f9-b385-bf8ab36b15c9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:50.488489 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-052ae9a9-067e-44f9-b385-bf8ab36b15c9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lazy-loading 'services' on Instance uuid 67827f2d-1e40-4e54-83b5-906368c76022 {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:31:50.597376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-052ae9a9-067e-44f9-b385-bf8ab36b15c9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "DELETE /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments/3d8f7571-0bb8-4af5-9242-fa6b9c6fc729" status: 202 len: 0 microversion: 2.1 time: 0.201149 Sep 13 03:31:50.597959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 553/1070] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 03:31:50 2022] DELETE /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments/3d8f7571-0bb8-4af5-9242-fa6b9c6fc729 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:31:51.304092 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-874a03a2-1567-439b-acca-50395e6b24ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:51.304732 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-874a03a2-1567-439b-acca-50395e6b24ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:51.311119 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-874a03a2-1567-439b-acca-50395e6b24ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:51.311605 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-874a03a2-1567-439b-acca-50395e6b24ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:51.312043 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-874a03a2-1567-439b-acca-50395e6b24ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:51.312729 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-874a03a2-1567-439b-acca-50395e6b24ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:51.313184 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-874a03a2-1567-439b-acca-50395e6b24ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:51.313605 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-874a03a2-1567-439b-acca-50395e6b24ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:51.440321 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-874a03a2-1567-439b-acca-50395e6b24ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:51.448411 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-874a03a2-1567-439b-acca-50395e6b24ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:51.449852 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-874a03a2-1567-439b-acca-50395e6b24ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:51.451037 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-874a03a2-1567-439b-acca-50395e6b24ea tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.150861 Sep 13 03:31:51.451592 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 518/1071] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:51 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:52.478191 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-2d99673f-f642-49b0-a065-9378e52d9a4d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:52.479133 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-2d99673f-f642-49b0-a065-9378e52d9a4d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:52.485809 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2d99673f-f642-49b0-a065-9378e52d9a4d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:52.486306 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2d99673f-f642-49b0-a065-9378e52d9a4d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:52.486769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2d99673f-f642-49b0-a065-9378e52d9a4d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:52.487476 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2d99673f-f642-49b0-a065-9378e52d9a4d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:52.487930 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2d99673f-f642-49b0-a065-9378e52d9a4d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:52.488354 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-2d99673f-f642-49b0-a065-9378e52d9a4d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:52.626146 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2d99673f-f642-49b0-a065-9378e52d9a4d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:52.634806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2d99673f-f642-49b0-a065-9378e52d9a4d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:52.636575 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-2d99673f-f642-49b0-a065-9378e52d9a4d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:52.637877 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-2d99673f-f642-49b0-a065-9378e52d9a4d tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1728 microversion: 2.20 time: 0.165481 Sep 13 03:31:52.638513 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 554/1072] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:52 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:52.870427 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-722643ed-5792-4dbd-82c1-d5ed9785b8e3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:52.873486 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-722643ed-5792-4dbd-82c1-d5ed9785b8e3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:52.880822 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-722643ed-5792-4dbd-82c1-d5ed9785b8e3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:52.881379 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-722643ed-5792-4dbd-82c1-d5ed9785b8e3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:52.881881 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-722643ed-5792-4dbd-82c1-d5ed9785b8e3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:52.882693 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-722643ed-5792-4dbd-82c1-d5ed9785b8e3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:52.883242 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-722643ed-5792-4dbd-82c1-d5ed9785b8e3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:52.883751 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-722643ed-5792-4dbd-82c1-d5ed9785b8e3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:52.916928 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-722643ed-5792-4dbd-82c1-d5ed9785b8e3 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052885 Sep 13 03:31:52.917691 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 519/1073] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:31:52 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 03:31:53.036914 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-29212e96-964c-4f95-becb-27db71ceb380 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:53.040851 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-29212e96-964c-4f95-becb-27db71ceb380 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:53.042843 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:53.048141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-29212e96-964c-4f95-becb-27db71ceb380 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:53.048629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-29212e96-964c-4f95-becb-27db71ceb380 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:53.049057 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-29212e96-964c-4f95-becb-27db71ceb380 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:53.049745 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-29212e96-964c-4f95-becb-27db71ceb380 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:53.050194 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-29212e96-964c-4f95-becb-27db71ceb380 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:53.050632 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-29212e96-964c-4f95-becb-27db71ceb380 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:53.080736 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-29212e96-964c-4f95-becb-27db71ceb380 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048945 Sep 13 03:31:53.081341 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 555/1074] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:31:53 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 03:31:53.143830 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d60350ea-91f7-480b-acfd-94610cd5378e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:53.144317 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d60350ea-91f7-480b-acfd-94610cd5378e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:53.150770 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d60350ea-91f7-480b-acfd-94610cd5378e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:53.151256 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d60350ea-91f7-480b-acfd-94610cd5378e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:53.151694 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d60350ea-91f7-480b-acfd-94610cd5378e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:53.152384 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d60350ea-91f7-480b-acfd-94610cd5378e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:53.152831 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d60350ea-91f7-480b-acfd-94610cd5378e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:53.153255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d60350ea-91f7-480b-acfd-94610cd5378e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:53.178258 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d60350ea-91f7-480b-acfd-94610cd5378e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:31:53.251873 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d60350ea-91f7-480b-acfd-94610cd5378e tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "DELETE /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 204 len: 0 microversion: 2.1 time: 0.111470 Sep 13 03:31:53.252374 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 520/1075] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:31:53 2022] DELETE /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:31:53.261213 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c2d61bbe-3918-4f65-93ee-1a481a828d9d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:53.261834 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c2d61bbe-3918-4f65-93ee-1a481a828d9d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:53.267879 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c2d61bbe-3918-4f65-93ee-1a481a828d9d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:53.268364 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c2d61bbe-3918-4f65-93ee-1a481a828d9d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:53.268793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c2d61bbe-3918-4f65-93ee-1a481a828d9d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:53.269505 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c2d61bbe-3918-4f65-93ee-1a481a828d9d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:53.269953 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c2d61bbe-3918-4f65-93ee-1a481a828d9d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:53.270373 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c2d61bbe-3918-4f65-93ee-1a481a828d9d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:53.397531 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c2d61bbe-3918-4f65-93ee-1a481a828d9d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:53.405172 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c2d61bbe-3918-4f65-93ee-1a481a828d9d tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1672 microversion: 2.1 time: 0.148028 Sep 13 03:31:53.405734 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 556/1076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:53 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:31:53.663849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-67fbc57e-45e3-49d8-b5b7-c90c469db106 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:53.664471 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-67fbc57e-45e3-49d8-b5b7-c90c469db106 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:53.670390 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67fbc57e-45e3-49d8-b5b7-c90c469db106 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:53.670906 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67fbc57e-45e3-49d8-b5b7-c90c469db106 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:53.671342 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67fbc57e-45e3-49d8-b5b7-c90c469db106 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:53.672025 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67fbc57e-45e3-49d8-b5b7-c90c469db106 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:53.672478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67fbc57e-45e3-49d8-b5b7-c90c469db106 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:53.672899 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-67fbc57e-45e3-49d8-b5b7-c90c469db106 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:53.804420 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-67fbc57e-45e3-49d8-b5b7-c90c469db106 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:53.812514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-67fbc57e-45e3-49d8-b5b7-c90c469db106 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:53.813949 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-67fbc57e-45e3-49d8-b5b7-c90c469db106 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:53.815163 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-67fbc57e-45e3-49d8-b5b7-c90c469db106 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1715 microversion: 2.20 time: 0.155914 Sep 13 03:31:53.815707 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 521/1077] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:31:53 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:31:54.428937 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-702bfd18-5f41-4590-b5ca-d943db84cb94 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:54.429579 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-702bfd18-5f41-4590-b5ca-d943db84cb94 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:54.436016 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-702bfd18-5f41-4590-b5ca-d943db84cb94 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:54.436504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-702bfd18-5f41-4590-b5ca-d943db84cb94 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:54.436945 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-702bfd18-5f41-4590-b5ca-d943db84cb94 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:54.437640 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-702bfd18-5f41-4590-b5ca-d943db84cb94 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:54.438098 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-702bfd18-5f41-4590-b5ca-d943db84cb94 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:54.438528 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-702bfd18-5f41-4590-b5ca-d943db84cb94 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:54.566667 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-702bfd18-5f41-4590-b5ca-d943db84cb94 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:54.575696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-702bfd18-5f41-4590-b5ca-d943db84cb94 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1672 microversion: 2.1 time: 0.151151 Sep 13 03:31:54.576265 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 557/1078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:54 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:31:55.599544 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-486a4d78-9105-42de-8444-1d0cfdc6d40a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:55.600189 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-486a4d78-9105-42de-8444-1d0cfdc6d40a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:55.602651 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:55.608761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-486a4d78-9105-42de-8444-1d0cfdc6d40a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:55.609243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-486a4d78-9105-42de-8444-1d0cfdc6d40a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:55.609674 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-486a4d78-9105-42de-8444-1d0cfdc6d40a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:55.610472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-486a4d78-9105-42de-8444-1d0cfdc6d40a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:55.610989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-486a4d78-9105-42de-8444-1d0cfdc6d40a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:55.611411 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-486a4d78-9105-42de-8444-1d0cfdc6d40a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:55.739507 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-486a4d78-9105-42de-8444-1d0cfdc6d40a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:55.747846 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-486a4d78-9105-42de-8444-1d0cfdc6d40a tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1672 microversion: 2.1 time: 0.152140 Sep 13 03:31:55.748404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 522/1079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:55 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:31:56.498081 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-0d34c211-2868-47a7-adba-0a9158afd6ca req-d983ef82-a23c-4e6d-967d-e4a448551527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67827f2d-1e40-4e54-83b5-906368c76022", "name": "network-vif-deleted", "tag": "3cf8c0a3-568d-455a-8ea4-b062a263d4f1"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:31:56.507570 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-0d34c211-2868-47a7-adba-0a9158afd6ca req-d983ef82-a23c-4e6d-967d-e4a448551527 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:56.508584 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-0d34c211-2868-47a7-adba-0a9158afd6ca req-d983ef82-a23c-4e6d-967d-e4a448551527 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:56.513447 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-0d34c211-2868-47a7-adba-0a9158afd6ca req-d983ef82-a23c-4e6d-967d-e4a448551527 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:56.527808 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-0d34c211-2868-47a7-adba-0a9158afd6ca req-d983ef82-a23c-4e6d-967d-e4a448551527 service nova] Creating event network-vif-deleted:3cf8c0a3-568d-455a-8ea4-b062a263d4f1 for instance 67827f2d-1e40-4e54-83b5-906368c76022 on hv-cinder-85707 Sep 13 03:31:56.534641 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-0d34c211-2868-47a7-adba-0a9158afd6ca req-d983ef82-a23c-4e6d-967d-e4a448551527 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100731 Sep 13 03:31:56.535927 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 558/1080] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:31:56.771736 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:56.772397 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:56.779117 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:56.779549 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:56.780081 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:56.780696 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:56.781161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:56.781603 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:56.812691 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:56.813177 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:56.813618 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:56.814072 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lazy-loading 'fault' on Instance uuid 67827f2d-1e40-4e54-83b5-906368c76022 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:31:56.855635 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f6f9a952d84ccab0de028d58aa6914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb8f67ac0f3c48b2933b6ae34d4fd838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:31:56.863367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-378b6c5a-ab8c-4d9e-b441-4d650c60c455 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 200 len: 1325 microversion: 2.1 time: 0.095675 Sep 13 03:31:56.863946 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 523/1081] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:56 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 1325 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:31:57.887920 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-94ac0473-7575-4018-ac58-bf9e7607e6f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:57.888631 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-94ac0473-7575-4018-ac58-bf9e7607e6f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:31:57.895377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-94ac0473-7575-4018-ac58-bf9e7607e6f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:57.895865 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-94ac0473-7575-4018-ac58-bf9e7607e6f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:57.896308 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-94ac0473-7575-4018-ac58-bf9e7607e6f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:57.897632 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-94ac0473-7575-4018-ac58-bf9e7607e6f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:31:57.898118 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-94ac0473-7575-4018-ac58-bf9e7607e6f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:31:57.898547 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-94ac0473-7575-4018-ac58-bf9e7607e6f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:31:57.911588 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-94ac0473-7575-4018-ac58-bf9e7607e6f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] HTTP exception thrown: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-94ac0473-7575-4018-ac58-bf9e7607e6f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Request method failure captured: Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 HTTP/1.1 Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_ccI8efIaRUA7ZVgB8Wgcwh_Bnp3zd1kXsary1kbD4u1sq1N4vdeZ4v_lvf04xAN98kEHQ2wAwnh31KTOBQAz2HyGUsJdq6DCie2mDoqB7SCms5cOk0Xf5u5jVcKjKBLoAjWHYHknJfwywjR80qK_6Jre0rEZvvkQpt9RLlxAFifP0 Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: bb8f67ac0f3c48b2933b6ae34d4fd838 Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:31:57.913501 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:31:57.915201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bb8f67ac0f3c48b2933b6ae34d4fd838", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}] Sep 13 03:31:57.915201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:31:57.915201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: bb8f67ac0f3c48b2933b6ae34d4fd838 Sep 13 03:31:57.915201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:31:57.915201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-AttachVolumeTestJSON-373766804-project Sep 13 03:31:57.915201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:31:57.915201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:31:57.915201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 80f6f9a952d84ccab0de028d58aa6914 Sep 13 03:31:57.915201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-AttachVolumeTestJSON-373766804-project Sep 13 03:31:57.915201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:31:57.915201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:31:57.915201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': '67827f2d-1e40-4e54-83b5-906368c76022'} Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:31:57.916064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:31:57.917414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:31:57.918571 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-94ac0473-7575-4018-ac58-bf9e7607e6f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Returning 404 to user: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:31:57.918571 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-94ac0473-7575-4018-ac58-bf9e7607e6f9 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 404 len: 111 microversion: 2.1 time: 0.031245 Sep 13 03:31:57.918571 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 559/1082] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:31:57 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:31:57.924900 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-643841fe-d466-4a1c-8da9-66502cc88ea8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '.version_select at 0x7f89356c2700>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:31:57.944002 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-643841fe-d466-4a1c-8da9-66502cc88ea8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-56091141" status: 202 len: 0 microversion: 2.1 time: 0.023408 Sep 13 03:31:57.944776 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 524/1083] 10.222.0.18 () {58 vars in 1215 bytes} [Tue Sep 13 03:31:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-56091141 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:32:00.819381 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-404f4176-7033-47f7-bda3-d89f1c582ec8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:00.820537 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-404f4176-7033-47f7-bda3-d89f1c582ec8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:00.827071 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-404f4176-7033-47f7-bda3-d89f1c582ec8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:00.827551 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-404f4176-7033-47f7-bda3-d89f1c582ec8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:00.827982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-404f4176-7033-47f7-bda3-d89f1c582ec8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:00.828663 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-404f4176-7033-47f7-bda3-d89f1c582ec8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:00.829112 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-404f4176-7033-47f7-bda3-d89f1c582ec8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:00.829533 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-404f4176-7033-47f7-bda3-d89f1c582ec8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:00.842449 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-404f4176-7033-47f7-bda3-d89f1c582ec8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] HTTP exception thrown: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-404f4176-7033-47f7-bda3-d89f1c582ec8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Request method failure captured: Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: DELETE /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 HTTP/1.1 Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_ccI8efIaRUA7ZVgB8Wgcwh_Bnp3zd1kXsary1kbD4u1sq1N4vdeZ4v_lvf04xAN98kEHQ2wAwnh31KTOBQAz2HyGUsJdq6DCie2mDoqB7SCms5cOk0Xf5u5jVcKjKBLoAjWHYHknJfwywjR80qK_6Jre0rEZvvkQpt9RLlxAFifP0 Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: bb8f67ac0f3c48b2933b6ae34d4fd838 Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:32:00.843967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:32:00.845549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bb8f67ac0f3c48b2933b6ae34d4fd838", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}] Sep 13 03:32:00.845549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:32:00.845549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: bb8f67ac0f3c48b2933b6ae34d4fd838 Sep 13 03:32:00.845549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:32:00.845549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-AttachVolumeTestJSON-373766804-project Sep 13 03:32:00.845549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:32:00.845549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:32:00.845549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 80f6f9a952d84ccab0de028d58aa6914 Sep 13 03:32:00.845549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-AttachVolumeTestJSON-373766804-project Sep 13 03:32:00.845549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:32:00.845549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:32:00.845549 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': '67827f2d-1e40-4e54-83b5-906368c76022'} Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:32:00.846445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:32:00.847940 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:32:00.849515 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-404f4176-7033-47f7-bda3-d89f1c582ec8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Returning 404 to user: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:32:00.849515 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-404f4176-7033-47f7-bda3-d89f1c582ec8 tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "DELETE /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 404 len: 111 microversion: 2.1 time: 0.029815 Sep 13 03:32:00.849515 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 560/1084] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:32:00 2022] DELETE /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:32:00.854405 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-521c7e02-a104-4bb4-9c12-06d91af0a8ad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:00.855053 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-521c7e02-a104-4bb4-9c12-06d91af0a8ad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: 67827f2d-1e40-4e54-83b5-906368c76022] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:00.862382 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-521c7e02-a104-4bb4-9c12-06d91af0a8ad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:00.862901 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-521c7e02-a104-4bb4-9c12-06d91af0a8ad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:00.863337 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-521c7e02-a104-4bb4-9c12-06d91af0a8ad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:00.864023 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-521c7e02-a104-4bb4-9c12-06d91af0a8ad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:00.864479 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-521c7e02-a104-4bb4-9c12-06d91af0a8ad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:00.864905 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-521c7e02-a104-4bb4-9c12-06d91af0a8ad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:00.878246 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-521c7e02-a104-4bb4-9c12-06d91af0a8ad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] HTTP exception thrown: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-521c7e02-a104-4bb4-9c12-06d91af0a8ad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Request method failure captured: Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 HTTP/1.1 Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_ccI8efIaRUA7ZVgB8Wgcwh_Bnp3zd1kXsary1kbD4u1sq1N4vdeZ4v_lvf04xAN98kEHQ2wAwnh31KTOBQAz2HyGUsJdq6DCie2mDoqB7SCms5cOk0Xf5u5jVcKjKBLoAjWHYHknJfwywjR80qK_6Jre0rEZvvkQpt9RLlxAFifP0 Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: bb8f67ac0f3c48b2933b6ae34d4fd838 Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:32:00.879916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:32:00.881545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bb8f67ac0f3c48b2933b6ae34d4fd838", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}] Sep 13 03:32:00.881545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:32:00.881545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: bb8f67ac0f3c48b2933b6ae34d4fd838 Sep 13 03:32:00.881545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:32:00.881545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeTestJSON-373766804-project Sep 13 03:32:00.881545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:32:00.881545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:32:00.881545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 80f6f9a952d84ccab0de028d58aa6914 Sep 13 03:32:00.881545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeTestJSON-373766804-project Sep 13 03:32:00.881545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:32:00.881545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:32:00.881545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': '67827f2d-1e40-4e54-83b5-906368c76022'} Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:32:00.883032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. Sep 13 03:32:00.884542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:32:00.885869 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-521c7e02-a104-4bb4-9c12-06d91af0a8ad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Returning 404 to user: Instance 67827f2d-1e40-4e54-83b5-906368c76022 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:32:00.885869 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-521c7e02-a104-4bb4-9c12-06d91af0a8ad tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022" status: 404 len: 111 microversion: 2.1 time: 0.031608 Sep 13 03:32:00.885869 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 525/1085] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:00 2022] GET /compute/v2.1/servers/67827f2d-1e40-4e54-83b5-906368c76022 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:32:02.020354 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3f4ed3c0-a6af-4b93-acfc-4f80917603be tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:02.020862 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3f4ed3c0-a6af-4b93-acfc-4f80917603be tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:02.027262 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f4ed3c0-a6af-4b93-acfc-4f80917603be tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:02.027753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f4ed3c0-a6af-4b93-acfc-4f80917603be tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:02.028221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f4ed3c0-a6af-4b93-acfc-4f80917603be tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:02.028916 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f4ed3c0-a6af-4b93-acfc-4f80917603be tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:02.029373 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f4ed3c0-a6af-4b93-acfc-4f80917603be tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:02.029804 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3f4ed3c0-a6af-4b93-acfc-4f80917603be tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:02.043609 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-3f4ed3c0-a6af-4b93-acfc-4f80917603be tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] HTTP exception thrown: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3f4ed3c0-a6af-4b93-acfc-4f80917603be tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Request method failure captured: Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: DELETE /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 HTTP/1.1 Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_ccI8efIaRUA7ZVgB8Wgcwh_Bnp3zd1kXsary1kbD4u1sq1N4vdeZ4v_lvf04xAN98kEHQ2wAwnh31KTOBQAz2HyGUsJdq6DCie2mDoqB7SCms5cOk0Xf5u5jVcKjKBLoAjWHYHknJfwywjR80qK_6Jre0rEZvvkQpt9RLlxAFifP0 Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: bb8f67ac0f3c48b2933b6ae34d4fd838 Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:32:02.045120 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:32:02.046761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bb8f67ac0f3c48b2933b6ae34d4fd838", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}] Sep 13 03:32:02.046761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:32:02.046761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: bb8f67ac0f3c48b2933b6ae34d4fd838 Sep 13 03:32:02.046761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:32:02.046761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-AttachVolumeTestJSON-373766804-project Sep 13 03:32:02.046761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:32:02.046761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:32:02.046761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 80f6f9a952d84ccab0de028d58aa6914 Sep 13 03:32:02.046761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-AttachVolumeTestJSON-373766804-project Sep 13 03:32:02.046761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:32:02.046761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:32:02.046761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81'} Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:32:02.047733 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:32:02.049258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:32:02.050944 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3f4ed3c0-a6af-4b93-acfc-4f80917603be tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Returning 404 to user: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:32:02.050944 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3f4ed3c0-a6af-4b93-acfc-4f80917603be tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 404 len: 111 microversion: 2.1 time: 0.030063 Sep 13 03:32:02.050944 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 561/1086] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:32:02 2022] DELETE /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 03:32:02.055345 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1b0dfd9c-ba81-44ca-89fc-20afb22eb81c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:02.055963 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-1b0dfd9c-ba81-44ca-89fc-20afb22eb81c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] [instance: c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:02.062146 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1b0dfd9c-ba81-44ca-89fc-20afb22eb81c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:02.062654 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1b0dfd9c-ba81-44ca-89fc-20afb22eb81c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:02.063095 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1b0dfd9c-ba81-44ca-89fc-20afb22eb81c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:02.063791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1b0dfd9c-ba81-44ca-89fc-20afb22eb81c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:02.064246 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1b0dfd9c-ba81-44ca-89fc-20afb22eb81c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:02.064671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1b0dfd9c-ba81-44ca-89fc-20afb22eb81c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:02.077963 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-1b0dfd9c-ba81-44ca-89fc-20afb22eb81c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] HTTP exception thrown: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1b0dfd9c-ba81-44ca-89fc-20afb22eb81c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Request method failure captured: Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 HTTP/1.1 Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_ccI8efIaRUA7ZVgB8Wgcwh_Bnp3zd1kXsary1kbD4u1sq1N4vdeZ4v_lvf04xAN98kEHQ2wAwnh31KTOBQAz2HyGUsJdq6DCie2mDoqB7SCms5cOk0Xf5u5jVcKjKBLoAjWHYHknJfwywjR80qK_6Jre0rEZvvkQpt9RLlxAFifP0 Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: bb8f67ac0f3c48b2933b6ae34d4fd838 Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:32:02.079545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:32:02.081131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bb8f67ac0f3c48b2933b6ae34d4fd838", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bb8f67ac0f3c48b2933b6ae34d4fd838"}]}] Sep 13 03:32:02.081131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:32:02.081131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: bb8f67ac0f3c48b2933b6ae34d4fd838 Sep 13 03:32:02.081131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeTestJSON-373766804 Sep 13 03:32:02.081131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeTestJSON-373766804-project Sep 13 03:32:02.081131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:32:02.081131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:32:02.081131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 80f6f9a952d84ccab0de028d58aa6914 Sep 13 03:32:02.081131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeTestJSON-373766804-project Sep 13 03:32:02.081131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:32:02.081131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:32:02.081131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': 'c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81'} Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:32:02.082250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. Sep 13 03:32:02.083796 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:32:02.085732 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1b0dfd9c-ba81-44ca-89fc-20afb22eb81c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] Returning 404 to user: Instance c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:32:02.085732 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1b0dfd9c-ba81-44ca-89fc-20afb22eb81c tempest-AttachVolumeTestJSON-373766804 tempest-AttachVolumeTestJSON-373766804-project] 10.222.0.18 "GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81" status: 404 len: 111 microversion: 2.1 time: 0.030082 Sep 13 03:32:02.085732 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 526/1087] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:02 2022] GET /compute/v2.1/servers/c2db9c7f-3243-4d1f-9ea1-ed8a976c4b81 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:32:07.736528 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-403cf026-f5aa-4cf5-b002-2d7858eecba5 tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] Calling method '.version_select at 0x7f8935715b80>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:07.782746 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-403cf026-f5aa-4cf5-b002-2d7858eecba5 tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c8ab7ff2-845f-4a57-93e2-9b615782c6fa" status: 200 len: 351 microversion: 2.1 time: 0.049953 Sep 13 03:32:07.783466 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 562/1088] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:32:07 2022] GET /compute/v2.1/os-volumes/c8ab7ff2-845f-4a57-93e2-9b615782c6fa => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:32:09.110603 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-afca6d05-c516-4515-a50d-1eb5d7534a1f tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] Calling method '.version_select at 0x7f8935728b80>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:09.157688 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-afca6d05-c516-4515-a50d-1eb5d7534a1f tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1d5415e3-2fa5-45ae-b2fb-5b5ca03bbd80" status: 200 len: 351 microversion: 2.1 time: 0.050803 Sep 13 03:32:09.158246 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 527/1089] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:32:09 2022] GET /compute/v2.1/os-volumes/1d5415e3-2fa5-45ae-b2fb-5b5ca03bbd80 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:32:10.488545 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3730d274-d1ae-4e7d-bc9b-5a4f21d4963b tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] Calling method '.version_select at 0x7f89359171f0>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:10.535995 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3730d274-d1ae-4e7d-bc9b-5a4f21d4963b tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2665e6c1-be19-48d7-9642-4b92cb9bcea8" status: 200 len: 351 microversion: 2.1 time: 0.051720 Sep 13 03:32:10.536558 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 563/1090] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:32:10 2022] GET /compute/v2.1/os-volumes/2665e6c1-be19-48d7-9642-4b92cb9bcea8 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:32:10.550012 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c5278c33-be9e-409f-8e59-572d8eb35def tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] Calling method '.version_select at 0x7f89356f88b0>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:10.635759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c5278c33-be9e-409f-8e59-572d8eb35def tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.089894 Sep 13 03:32:10.636332 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 528/1091] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Sep 13 03:32:10 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:10.650097 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-442520f5-1a01-4586-bffb-104a4c8c58f6 tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] Calling method '.version_select at 0x7f8935917a60>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:10.731640 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-442520f5-1a01-4586-bffb-104a4c8c58f6 tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085184 Sep 13 03:32:10.732207 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 564/1092] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Sep 13 03:32:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:32:10.746248 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7f72cbd1-f6fb-4a8b-ad56-cd94eedf41ff tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] Calling method '.version_select at 0x7f89356ec820>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:10.826449 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7f72cbd1-f6fb-4a8b-ad56-cd94eedf41ff tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.084490 Sep 13 03:32:10.827050 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 529/1093] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Sep 13 03:32:10 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:10.840148 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ff7386c0-390a-480a-9d58-1d3050697cf6 tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] Calling method '.version_select at 0x7f893583aaf0>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:10.920519 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ff7386c0-390a-480a-9d58-1d3050697cf6 tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084123 Sep 13 03:32:10.921142 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 565/1094] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Sep 13 03:32:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:32:10.935525 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-896e0da6-52cf-4a74-9215-b350fc564aad tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] Calling method '.version_select at 0x7f8935732b80>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:11.015765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-896e0da6-52cf-4a74-9215-b350fc564aad tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084031 Sep 13 03:32:11.016329 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 530/1095] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Sep 13 03:32:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:32:11.030375 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1581dd0f-2083-4490-b597-d4a73b97744c tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] Calling method '.version_select at 0x7f8935917160>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:11.111186 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1581dd0f-2083-4490-b597-d4a73b97744c tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084536 Sep 13 03:32:11.111752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 566/1096] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Sep 13 03:32:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:11.125517 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c43387d5-8e8c-4661-89a6-5705d4ac81cf tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] Calling method '.version_select at 0x7f89356f8af0>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:11.206446 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c43387d5-8e8c-4661-89a6-5705d4ac81cf tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084596 Sep 13 03:32:11.207050 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 531/1097] 10.222.0.18 () {58 vars in 1188 bytes} [Tue Sep 13 03:32:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:32:11.220206 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4e2fa997-cc7b-4d23-ab4e-153d9054d729 tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] Calling method '.version_select at 0x7f89358e8ca0>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:11.303614 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4e2fa997-cc7b-4d23-ab4e-153d9054d729 tempest-VolumesTestJSON-1107726590 tempest-VolumesTestJSON-1107726590-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.087041 Sep 13 03:32:11.304690 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 567/1098] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Sep 13 03:32:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:27.618497 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:27.619200 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:27.623224 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e2971047-318c-45b0-a796-bb9ba451beca tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:32:27.625398 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e2971047-318c-45b0-a796-bb9ba451beca tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:27.632479 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e2971047-318c-45b0-a796-bb9ba451beca tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:27.632964 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e2971047-318c-45b0-a796-bb9ba451beca tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:27.633393 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e2971047-318c-45b0-a796-bb9ba451beca tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:27.634114 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e2971047-318c-45b0-a796-bb9ba451beca tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:27.634570 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e2971047-318c-45b0-a796-bb9ba451beca tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:27.635012 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e2971047-318c-45b0-a796-bb9ba451beca tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:27.703596 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e2971047-318c-45b0-a796-bb9ba451beca tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "POST /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/action" status: 202 len: 0 microversion: 2.1 time: 0.086148 Sep 13 03:32:27.707127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 532/1099] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:32:27 2022] POST /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:32:27.709766 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=13 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:27.710603 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:27.715094 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d1b6b709-4307-46a5-9ffa-621d86166128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:27.715704 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d1b6b709-4307-46a5-9ffa-621d86166128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:27.722597 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1b6b709-4307-46a5-9ffa-621d86166128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:27.723018 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1b6b709-4307-46a5-9ffa-621d86166128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:27.723451 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1b6b709-4307-46a5-9ffa-621d86166128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:27.724143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1b6b709-4307-46a5-9ffa-621d86166128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:27.724597 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1b6b709-4307-46a5-9ffa-621d86166128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:27.725017 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d1b6b709-4307-46a5-9ffa-621d86166128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:27.947512 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d1b6b709-4307-46a5-9ffa-621d86166128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:27.955808 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d1b6b709-4307-46a5-9ffa-621d86166128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1752 microversion: 2.1 time: 0.247458 Sep 13 03:32:27.956373 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 568/1100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:27 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1752 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:32:28.981011 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9c913dfc-97eb-4de4-b662-3e51a43fd748 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:28.981710 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9c913dfc-97eb-4de4-b662-3e51a43fd748 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:28.987810 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9c913dfc-97eb-4de4-b662-3e51a43fd748 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:28.988293 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9c913dfc-97eb-4de4-b662-3e51a43fd748 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:28.988730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9c913dfc-97eb-4de4-b662-3e51a43fd748 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:28.989417 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9c913dfc-97eb-4de4-b662-3e51a43fd748 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:28.989869 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9c913dfc-97eb-4de4-b662-3e51a43fd748 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:28.990291 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9c913dfc-97eb-4de4-b662-3e51a43fd748 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:29.131884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-9c913dfc-97eb-4de4-b662-3e51a43fd748 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:29.140226 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9c913dfc-97eb-4de4-b662-3e51a43fd748 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.164447 Sep 13 03:32:29.140792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 533/1101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:28 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:30.164115 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-348967bf-49f4-4cf4-86f9-58dd874a27ee tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:30.164670 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-348967bf-49f4-4cf4-86f9-58dd874a27ee tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:30.171632 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-348967bf-49f4-4cf4-86f9-58dd874a27ee tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:30.172117 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-348967bf-49f4-4cf4-86f9-58dd874a27ee tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:30.172557 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-348967bf-49f4-4cf4-86f9-58dd874a27ee tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:30.173249 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-348967bf-49f4-4cf4-86f9-58dd874a27ee tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:30.173705 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-348967bf-49f4-4cf4-86f9-58dd874a27ee tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:30.174128 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-348967bf-49f4-4cf4-86f9-58dd874a27ee tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:30.316856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-348967bf-49f4-4cf4-86f9-58dd874a27ee tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:30.325171 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-348967bf-49f4-4cf4-86f9-58dd874a27ee tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.165213 Sep 13 03:32:30.325736 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 569/1102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:30 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:31.348435 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-60ea7d50-0449-4e29-a202-68ffdb852ee3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:31.348986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-60ea7d50-0449-4e29-a202-68ffdb852ee3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:31.355454 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-60ea7d50-0449-4e29-a202-68ffdb852ee3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:31.355939 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-60ea7d50-0449-4e29-a202-68ffdb852ee3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:31.356374 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-60ea7d50-0449-4e29-a202-68ffdb852ee3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:31.357062 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-60ea7d50-0449-4e29-a202-68ffdb852ee3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:31.357513 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-60ea7d50-0449-4e29-a202-68ffdb852ee3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:31.357933 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-60ea7d50-0449-4e29-a202-68ffdb852ee3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:31.498183 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-60ea7d50-0449-4e29-a202-68ffdb852ee3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:31.506321 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-60ea7d50-0449-4e29-a202-68ffdb852ee3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.161877 Sep 13 03:32:31.506909 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 534/1103] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:31 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:32.530352 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-46de9d67-48e0-4811-a5a9-62984c918068 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:32.531060 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-46de9d67-48e0-4811-a5a9-62984c918068 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:32.537206 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-46de9d67-48e0-4811-a5a9-62984c918068 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:32.537938 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-46de9d67-48e0-4811-a5a9-62984c918068 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:32.538367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-46de9d67-48e0-4811-a5a9-62984c918068 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:32.539086 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-46de9d67-48e0-4811-a5a9-62984c918068 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:32.539535 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-46de9d67-48e0-4811-a5a9-62984c918068 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:32.539952 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-46de9d67-48e0-4811-a5a9-62984c918068 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:32.684654 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-46de9d67-48e0-4811-a5a9-62984c918068 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:32.693565 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-46de9d67-48e0-4811-a5a9-62984c918068 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.167008 Sep 13 03:32:32.694179 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 570/1104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:32 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:32.730212 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1011547151", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-196387094", "security_groups": [{"name": "tempest-secgroup-smoke-2028642222"}], "block_device_mapping_v2": [{"uuid": "3cf8861b-8268-4e5e-8332-2cace6c3f833", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "93f6860d-aa52-425f-a0b7-a39e9fc582c8"}]}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:32:32.849566 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.network.neutron [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] validate_networks() for [('93f6860d-aa52-425f-a0b7-a39e9fc582c8', None, None, None, None, None)] {{(pid=120384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:32:33.433372 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Flavor limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:32:33.433797 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Image limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:32:33.434290 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Flavor pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:32:33.434732 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Image pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:32:33.435144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:32:33.444526 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:33.445011 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:33.445448 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:33.446179 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:33.446870 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:33.447303 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:33.463609 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Getting quotas for project ab6c92ba81254caaad368fd0ef382b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:32:33.467480 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Getting quotas for user 47fa1f7ce54145ceb3564b9ba7b4964f and project ab6c92ba81254caaad368fd0ef382b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:32:33.523243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Going to run 1 instances... {{(pid=120384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:32:33.525907 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3cf8861b-8268-4e5e-8332-2cace6c3f833',volume_size=None,volume_type=None)] {{(pid=120384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:32:33.652780 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5b791684-5e1c-400e-ad52-3eb7aade2fa3 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.926421 Sep 13 03:32:33.653419 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 535/1105] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:32:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:32:33.664626 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b9e871fb-167c-4a6b-8741-d674a0a15225 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:33.665827 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b9e871fb-167c-4a6b-8741-d674a0a15225 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:33.717566 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-dba5490d-3da9-4e67-8b7a-9c2ddf67ba82 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:33.718239 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-dba5490d-3da9-4e67-8b7a-9c2ddf67ba82 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:33.719267 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b9e871fb-167c-4a6b-8741-d674a0a15225 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:33.724857 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dba5490d-3da9-4e67-8b7a-9c2ddf67ba82 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:33.725351 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dba5490d-3da9-4e67-8b7a-9c2ddf67ba82 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:33.725977 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dba5490d-3da9-4e67-8b7a-9c2ddf67ba82 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:33.726712 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b9e871fb-167c-4a6b-8741-d674a0a15225 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1094 microversion: 2.1 time: 0.066032 Sep 13 03:32:33.728187 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 571/1106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:33 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:32:33.728669 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dba5490d-3da9-4e67-8b7a-9c2ddf67ba82 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:33.729212 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dba5490d-3da9-4e67-8b7a-9c2ddf67ba82 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:33.729645 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-dba5490d-3da9-4e67-8b7a-9c2ddf67ba82 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:33.901969 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-dba5490d-3da9-4e67-8b7a-9c2ddf67ba82 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:33.910107 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-dba5490d-3da9-4e67-8b7a-9c2ddf67ba82 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.196359 Sep 13 03:32:33.910695 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 536/1107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:33 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:32:34.750322 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0cb4d6bb-598f-41ea-a5d2-3e42f70d790b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:34.750880 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0cb4d6bb-598f-41ea-a5d2-3e42f70d790b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:34.758024 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0cb4d6bb-598f-41ea-a5d2-3e42f70d790b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:34.758504 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0cb4d6bb-598f-41ea-a5d2-3e42f70d790b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:34.758965 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0cb4d6bb-598f-41ea-a5d2-3e42f70d790b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:34.759719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0cb4d6bb-598f-41ea-a5d2-3e42f70d790b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:34.760170 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0cb4d6bb-598f-41ea-a5d2-3e42f70d790b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:34.760592 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0cb4d6bb-598f-41ea-a5d2-3e42f70d790b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:34.828189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0cb4d6bb-598f-41ea-a5d2-3e42f70d790b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:34.836197 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0cb4d6bb-598f-41ea-a5d2-3e42f70d790b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1192 microversion: 2.1 time: 0.089748 Sep 13 03:32:34.836844 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 572/1108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:34 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:34.933781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6776f3bd-d9b6-4994-9bb1-75e45bede796 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:34.934391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6776f3bd-d9b6-4994-9bb1-75e45bede796 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:34.945026 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6776f3bd-d9b6-4994-9bb1-75e45bede796 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:34.945520 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6776f3bd-d9b6-4994-9bb1-75e45bede796 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:34.945954 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6776f3bd-d9b6-4994-9bb1-75e45bede796 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:34.946657 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6776f3bd-d9b6-4994-9bb1-75e45bede796 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:34.955775 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6776f3bd-d9b6-4994-9bb1-75e45bede796 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:34.956228 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6776f3bd-d9b6-4994-9bb1-75e45bede796 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:35.132806 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-6776f3bd-d9b6-4994-9bb1-75e45bede796 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:35.141120 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6776f3bd-d9b6-4994-9bb1-75e45bede796 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.211696 Sep 13 03:32:35.141692 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 537/1109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:34 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:32:35.859388 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c0fddeaa-e04c-4eb5-a4aa-88fe1c44b29c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:35.867419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c0fddeaa-e04c-4eb5-a4aa-88fe1c44b29c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:35.874856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c0fddeaa-e04c-4eb5-a4aa-88fe1c44b29c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:35.875412 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c0fddeaa-e04c-4eb5-a4aa-88fe1c44b29c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:35.875920 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c0fddeaa-e04c-4eb5-a4aa-88fe1c44b29c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:35.876745 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c0fddeaa-e04c-4eb5-a4aa-88fe1c44b29c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:35.877242 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c0fddeaa-e04c-4eb5-a4aa-88fe1c44b29c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:35.877740 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c0fddeaa-e04c-4eb5-a4aa-88fe1c44b29c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:36.098445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c0fddeaa-e04c-4eb5-a4aa-88fe1c44b29c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:36.106797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c0fddeaa-e04c-4eb5-a4aa-88fe1c44b29c tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1278 microversion: 2.1 time: 0.251265 Sep 13 03:32:36.107372 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 573/1110] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:35 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1278 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:36.165372 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-48f5cfa1-a224-46f7-b043-bfb124451571 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:36.166603 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-48f5cfa1-a224-46f7-b043-bfb124451571 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:36.173279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48f5cfa1-a224-46f7-b043-bfb124451571 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:36.173783 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48f5cfa1-a224-46f7-b043-bfb124451571 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:36.174357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48f5cfa1-a224-46f7-b043-bfb124451571 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:36.175054 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48f5cfa1-a224-46f7-b043-bfb124451571 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:36.175539 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48f5cfa1-a224-46f7-b043-bfb124451571 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:36.175967 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-48f5cfa1-a224-46f7-b043-bfb124451571 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:36.327506 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-48f5cfa1-a224-46f7-b043-bfb124451571 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:36.336521 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-48f5cfa1-a224-46f7-b043-bfb124451571 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.175247 Sep 13 03:32:36.337262 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 538/1111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:36 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:36.727531 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-b2225b21-5c04-4afb-b29e-491cc9f08c90 req-d56026f2-84e5-428d-8695-ec29a7aa711a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e452a83d-d2f5-4167-89b8-f02e61173b84", "tag": "5eb326a8-8417-4b1c-a306-3720fd092e50"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:32:36.738233 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-b2225b21-5c04-4afb-b29e-491cc9f08c90 req-d56026f2-84e5-428d-8695-ec29a7aa711a service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:36.738846 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-b2225b21-5c04-4afb-b29e-491cc9f08c90 req-d56026f2-84e5-428d-8695-ec29a7aa711a service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:36.739346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-b2225b21-5c04-4afb-b29e-491cc9f08c90 req-d56026f2-84e5-428d-8695-ec29a7aa711a service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:36.750119 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-b2225b21-5c04-4afb-b29e-491cc9f08c90 req-d56026f2-84e5-428d-8695-ec29a7aa711a service nova] Creating event network-changed:5eb326a8-8417-4b1c-a306-3720fd092e50 for instance e452a83d-d2f5-4167-89b8-f02e61173b84 on hv-cinder-85707 Sep 13 03:32:36.755063 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-b2225b21-5c04-4afb-b29e-491cc9f08c90 req-d56026f2-84e5-428d-8695-ec29a7aa711a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031379 Sep 13 03:32:36.755747 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 574/1112] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:32:37.130333 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-87747236-cd52-4203-81bc-9be73a542073 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:37.130997 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-87747236-cd52-4203-81bc-9be73a542073 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:37.137731 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87747236-cd52-4203-81bc-9be73a542073 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:37.138218 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87747236-cd52-4203-81bc-9be73a542073 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:37.139300 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87747236-cd52-4203-81bc-9be73a542073 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:37.140198 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87747236-cd52-4203-81bc-9be73a542073 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:37.140653 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87747236-cd52-4203-81bc-9be73a542073 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:37.141074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-87747236-cd52-4203-81bc-9be73a542073 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:37.278759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-87747236-cd52-4203-81bc-9be73a542073 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:37.286998 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-87747236-cd52-4203-81bc-9be73a542073 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1266 microversion: 2.1 time: 0.160417 Sep 13 03:32:37.287824 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 539/1113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:37 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:37.362367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a6ffa972-5062-4a89-9893-613de7f9ae32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:37.363084 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a6ffa972-5062-4a89-9893-613de7f9ae32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:37.369231 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6ffa972-5062-4a89-9893-613de7f9ae32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:37.369709 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6ffa972-5062-4a89-9893-613de7f9ae32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:37.370144 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6ffa972-5062-4a89-9893-613de7f9ae32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:37.370850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6ffa972-5062-4a89-9893-613de7f9ae32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:37.371301 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6ffa972-5062-4a89-9893-613de7f9ae32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:37.372454 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6ffa972-5062-4a89-9893-613de7f9ae32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:37.516906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a6ffa972-5062-4a89-9893-613de7f9ae32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:37.525009 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a6ffa972-5062-4a89-9893-613de7f9ae32 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.167379 Sep 13 03:32:37.525565 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 575/1114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:37 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:38.310257 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-88c6e151-5903-435b-8e02-07cbd64f3845 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:38.310908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-88c6e151-5903-435b-8e02-07cbd64f3845 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:38.317367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-88c6e151-5903-435b-8e02-07cbd64f3845 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:38.317862 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-88c6e151-5903-435b-8e02-07cbd64f3845 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:38.318305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-88c6e151-5903-435b-8e02-07cbd64f3845 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:38.319041 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-88c6e151-5903-435b-8e02-07cbd64f3845 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:38.319504 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-88c6e151-5903-435b-8e02-07cbd64f3845 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:38.319934 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-88c6e151-5903-435b-8e02-07cbd64f3845 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:38.516863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-88c6e151-5903-435b-8e02-07cbd64f3845 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:38.532966 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-88c6e151-5903-435b-8e02-07cbd64f3845 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1266 microversion: 2.1 time: 0.226604 Sep 13 03:32:38.533561 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 540/1115] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:38 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:38.553653 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-bf166392-3b07-492a-8b52-866724d17a50 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:38.554884 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-bf166392-3b07-492a-8b52-866724d17a50 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:38.561384 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bf166392-3b07-492a-8b52-866724d17a50 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:38.561872 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bf166392-3b07-492a-8b52-866724d17a50 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:38.562494 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bf166392-3b07-492a-8b52-866724d17a50 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:38.563223 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bf166392-3b07-492a-8b52-866724d17a50 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:38.563679 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bf166392-3b07-492a-8b52-866724d17a50 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:38.564105 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bf166392-3b07-492a-8b52-866724d17a50 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:38.762752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-bf166392-3b07-492a-8b52-866724d17a50 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:38.773347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-bf166392-3b07-492a-8b52-866724d17a50 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.225075 Sep 13 03:32:38.774063 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 576/1116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:38 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:39.559258 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b391193c-6731-480e-8df2-422e8f2b6965 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:39.559938 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b391193c-6731-480e-8df2-422e8f2b6965 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:39.566385 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b391193c-6731-480e-8df2-422e8f2b6965 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:39.566964 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b391193c-6731-480e-8df2-422e8f2b6965 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:39.567392 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b391193c-6731-480e-8df2-422e8f2b6965 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:39.568080 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b391193c-6731-480e-8df2-422e8f2b6965 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:39.568528 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b391193c-6731-480e-8df2-422e8f2b6965 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:39.568943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b391193c-6731-480e-8df2-422e8f2b6965 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:39.704179 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b391193c-6731-480e-8df2-422e8f2b6965 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:39.713569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b391193c-6731-480e-8df2-422e8f2b6965 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1266 microversion: 2.1 time: 0.157539 Sep 13 03:32:39.717380 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 541/1117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:39 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:39.797657 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-baf97e8e-0824-49e5-a5a6-a1f3180003b0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:39.798405 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-baf97e8e-0824-49e5-a5a6-a1f3180003b0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:39.811823 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-baf97e8e-0824-49e5-a5a6-a1f3180003b0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:39.812407 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-baf97e8e-0824-49e5-a5a6-a1f3180003b0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:39.813049 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-baf97e8e-0824-49e5-a5a6-a1f3180003b0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:39.813879 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-baf97e8e-0824-49e5-a5a6-a1f3180003b0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:39.814398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-baf97e8e-0824-49e5-a5a6-a1f3180003b0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:39.814911 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-baf97e8e-0824-49e5-a5a6-a1f3180003b0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:39.964927 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-baf97e8e-0824-49e5-a5a6-a1f3180003b0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:39.973237 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-baf97e8e-0824-49e5-a5a6-a1f3180003b0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.179364 Sep 13 03:32:39.973802 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 577/1118] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:39 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:40.735148 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f268f636-540f-4b62-8690-2d7c17e1452e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:40.735761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f268f636-540f-4b62-8690-2d7c17e1452e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:40.742025 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f268f636-540f-4b62-8690-2d7c17e1452e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:40.742506 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f268f636-540f-4b62-8690-2d7c17e1452e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:40.742971 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f268f636-540f-4b62-8690-2d7c17e1452e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:40.743652 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f268f636-540f-4b62-8690-2d7c17e1452e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:40.744686 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f268f636-540f-4b62-8690-2d7c17e1452e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:40.745111 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f268f636-540f-4b62-8690-2d7c17e1452e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:40.888983 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f268f636-540f-4b62-8690-2d7c17e1452e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:40.897788 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f268f636-540f-4b62-8690-2d7c17e1452e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1266 microversion: 2.1 time: 0.166347 Sep 13 03:32:40.898359 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 542/1119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:40 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:40.997532 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d204f295-89a0-4d2e-a788-186b398fa4e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:40.998150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d204f295-89a0-4d2e-a788-186b398fa4e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:41.004542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d204f295-89a0-4d2e-a788-186b398fa4e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:41.005031 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d204f295-89a0-4d2e-a788-186b398fa4e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:41.005498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d204f295-89a0-4d2e-a788-186b398fa4e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:41.006190 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d204f295-89a0-4d2e-a788-186b398fa4e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:41.006677 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d204f295-89a0-4d2e-a788-186b398fa4e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:41.007107 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d204f295-89a0-4d2e-a788-186b398fa4e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:41.149258 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d204f295-89a0-4d2e-a788-186b398fa4e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:41.157856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d204f295-89a0-4d2e-a788-186b398fa4e3 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.164790 Sep 13 03:32:41.158411 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 578/1120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:40 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:41.921352 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d8103b04-5b3a-423f-a59e-0505ad0ca423 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:41.921972 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d8103b04-5b3a-423f-a59e-0505ad0ca423 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:41.928369 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d8103b04-5b3a-423f-a59e-0505ad0ca423 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:41.928858 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d8103b04-5b3a-423f-a59e-0505ad0ca423 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:41.929300 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d8103b04-5b3a-423f-a59e-0505ad0ca423 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:41.929999 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d8103b04-5b3a-423f-a59e-0505ad0ca423 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:41.930463 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d8103b04-5b3a-423f-a59e-0505ad0ca423 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:41.931175 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d8103b04-5b3a-423f-a59e-0505ad0ca423 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:42.070495 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-d8103b04-5b3a-423f-a59e-0505ad0ca423 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:42.078863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d8103b04-5b3a-423f-a59e-0505ad0ca423 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1266 microversion: 2.1 time: 0.161310 Sep 13 03:32:42.079432 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 543/1121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:41 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:42.181304 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f40a771c-7065-46fb-997d-3b4f85b90128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:42.182573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f40a771c-7065-46fb-997d-3b4f85b90128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:42.189136 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f40a771c-7065-46fb-997d-3b4f85b90128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:42.189626 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f40a771c-7065-46fb-997d-3b4f85b90128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:42.190066 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f40a771c-7065-46fb-997d-3b4f85b90128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:42.190795 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f40a771c-7065-46fb-997d-3b4f85b90128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:42.191364 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f40a771c-7065-46fb-997d-3b4f85b90128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:42.191793 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f40a771c-7065-46fb-997d-3b4f85b90128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:42.339911 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f40a771c-7065-46fb-997d-3b4f85b90128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:42.349635 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f40a771c-7065-46fb-997d-3b4f85b90128 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.172155 Sep 13 03:32:42.350253 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 579/1122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:42 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:43.101493 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-26929fec-e86e-4fbd-ba9a-37fde13d6a7e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:43.102109 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-26929fec-e86e-4fbd-ba9a-37fde13d6a7e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:43.109030 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26929fec-e86e-4fbd-ba9a-37fde13d6a7e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:43.109517 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26929fec-e86e-4fbd-ba9a-37fde13d6a7e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:43.109956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26929fec-e86e-4fbd-ba9a-37fde13d6a7e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:43.110665 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26929fec-e86e-4fbd-ba9a-37fde13d6a7e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:43.111123 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26929fec-e86e-4fbd-ba9a-37fde13d6a7e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:43.111547 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-26929fec-e86e-4fbd-ba9a-37fde13d6a7e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:43.239357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-26929fec-e86e-4fbd-ba9a-37fde13d6a7e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:43.247425 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-26929fec-e86e-4fbd-ba9a-37fde13d6a7e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1266 microversion: 2.1 time: 0.149832 Sep 13 03:32:43.248009 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 544/1123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:43 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:43.374313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-23936c5f-b5ce-4159-8c4b-a1af8256c75e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:43.374898 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-23936c5f-b5ce-4159-8c4b-a1af8256c75e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:43.381221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-23936c5f-b5ce-4159-8c4b-a1af8256c75e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:43.381704 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-23936c5f-b5ce-4159-8c4b-a1af8256c75e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:43.382137 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-23936c5f-b5ce-4159-8c4b-a1af8256c75e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:43.382850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-23936c5f-b5ce-4159-8c4b-a1af8256c75e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:43.383308 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-23936c5f-b5ce-4159-8c4b-a1af8256c75e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:43.383731 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-23936c5f-b5ce-4159-8c4b-a1af8256c75e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:43.532939 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-23936c5f-b5ce-4159-8c4b-a1af8256c75e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:43.541825 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-23936c5f-b5ce-4159-8c4b-a1af8256c75e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.170830 Sep 13 03:32:43.542721 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 580/1124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:43 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:44.269276 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-78160931-a8fc-4e44-9aca-eb712758782e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:44.269893 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-78160931-a8fc-4e44-9aca-eb712758782e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:44.272849 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:44.273488 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=6 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:44.278411 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78160931-a8fc-4e44-9aca-eb712758782e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:44.278928 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78160931-a8fc-4e44-9aca-eb712758782e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:44.279457 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78160931-a8fc-4e44-9aca-eb712758782e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:44.280065 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78160931-a8fc-4e44-9aca-eb712758782e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:44.280530 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78160931-a8fc-4e44-9aca-eb712758782e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:44.280948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-78160931-a8fc-4e44-9aca-eb712758782e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:44.417954 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-78160931-a8fc-4e44-9aca-eb712758782e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:44.426217 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-78160931-a8fc-4e44-9aca-eb712758782e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1266 microversion: 2.1 time: 0.160534 Sep 13 03:32:44.426832 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 545/1125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:44 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:44.564739 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-97d9a010-ad5f-4834-83d6-b72bfd759f3c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:44.565410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-97d9a010-ad5f-4834-83d6-b72bfd759f3c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:44.567346 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:44.574017 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-97d9a010-ad5f-4834-83d6-b72bfd759f3c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:44.574792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-97d9a010-ad5f-4834-83d6-b72bfd759f3c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:44.575116 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-97d9a010-ad5f-4834-83d6-b72bfd759f3c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:44.575818 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-97d9a010-ad5f-4834-83d6-b72bfd759f3c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:44.576274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-97d9a010-ad5f-4834-83d6-b72bfd759f3c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:44.576780 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-97d9a010-ad5f-4834-83d6-b72bfd759f3c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:44.732575 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-97d9a010-ad5f-4834-83d6-b72bfd759f3c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:44.742996 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-97d9a010-ad5f-4834-83d6-b72bfd759f3c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.182135 Sep 13 03:32:44.743684 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 581/1126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:44 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:45.449656 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1b0ebf43-c0e3-4a62-9c95-69d32313838a tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:45.450271 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-1b0ebf43-c0e3-4a62-9c95-69d32313838a tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:45.456626 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1b0ebf43-c0e3-4a62-9c95-69d32313838a tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:45.457094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1b0ebf43-c0e3-4a62-9c95-69d32313838a tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:45.457528 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1b0ebf43-c0e3-4a62-9c95-69d32313838a tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:45.458221 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1b0ebf43-c0e3-4a62-9c95-69d32313838a tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:45.458701 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1b0ebf43-c0e3-4a62-9c95-69d32313838a tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:45.459129 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1b0ebf43-c0e3-4a62-9c95-69d32313838a tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:45.596441 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-1b0ebf43-c0e3-4a62-9c95-69d32313838a tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:45.604973 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1b0ebf43-c0e3-4a62-9c95-69d32313838a tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1266 microversion: 2.1 time: 0.159656 Sep 13 03:32:45.605544 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 546/1127] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:45 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:45.770409 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-257ea58b-8504-4864-bebc-13d39d9f33c2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:45.771125 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-257ea58b-8504-4864-bebc-13d39d9f33c2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:45.780049 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-257ea58b-8504-4864-bebc-13d39d9f33c2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:45.780466 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-257ea58b-8504-4864-bebc-13d39d9f33c2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:45.780894 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-257ea58b-8504-4864-bebc-13d39d9f33c2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:45.781590 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-257ea58b-8504-4864-bebc-13d39d9f33c2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:45.782041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-257ea58b-8504-4864-bebc-13d39d9f33c2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:45.782459 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-257ea58b-8504-4864-bebc-13d39d9f33c2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:45.935296 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-257ea58b-8504-4864-bebc-13d39d9f33c2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:45.945397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-257ea58b-8504-4864-bebc-13d39d9f33c2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1757 microversion: 2.1 time: 0.179322 Sep 13 03:32:45.945983 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 582/1128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:45 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:46.629850 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e1d1ba3b-f122-47ac-a053-8bcf8847e4a9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:46.630467 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e1d1ba3b-f122-47ac-a053-8bcf8847e4a9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:46.637685 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1d1ba3b-f122-47ac-a053-8bcf8847e4a9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:46.638179 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1d1ba3b-f122-47ac-a053-8bcf8847e4a9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:46.638631 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1d1ba3b-f122-47ac-a053-8bcf8847e4a9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:46.639343 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1d1ba3b-f122-47ac-a053-8bcf8847e4a9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:46.639812 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1d1ba3b-f122-47ac-a053-8bcf8847e4a9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:46.640231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e1d1ba3b-f122-47ac-a053-8bcf8847e4a9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:46.780606 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-e1d1ba3b-f122-47ac-a053-8bcf8847e4a9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:46.788318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e1d1ba3b-f122-47ac-a053-8bcf8847e4a9 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1266 microversion: 2.1 time: 0.162653 Sep 13 03:32:46.789185 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 547/1129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:46 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:46.969653 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c8e8d56d-cb82-429a-b94f-e80814dc644f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:46.971335 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c8e8d56d-cb82-429a-b94f-e80814dc644f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:46.978720 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c8e8d56d-cb82-429a-b94f-e80814dc644f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:46.979300 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c8e8d56d-cb82-429a-b94f-e80814dc644f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:46.980252 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c8e8d56d-cb82-429a-b94f-e80814dc644f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:46.981247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c8e8d56d-cb82-429a-b94f-e80814dc644f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:46.982541 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c8e8d56d-cb82-429a-b94f-e80814dc644f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:46.983096 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c8e8d56d-cb82-429a-b94f-e80814dc644f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:47.190085 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c8e8d56d-cb82-429a-b94f-e80814dc644f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:47.199068 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c8e8d56d-cb82-429a-b94f-e80814dc644f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1760 microversion: 2.1 time: 0.233623 Sep 13 03:32:47.199785 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 583/1130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:46 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1760 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:47.811577 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-39cf3198-131d-45c7-af78-e6050a3fce6b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:47.812187 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-39cf3198-131d-45c7-af78-e6050a3fce6b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:47.818630 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-39cf3198-131d-45c7-af78-e6050a3fce6b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:47.819137 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-39cf3198-131d-45c7-af78-e6050a3fce6b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:47.819565 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-39cf3198-131d-45c7-af78-e6050a3fce6b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:47.820251 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-39cf3198-131d-45c7-af78-e6050a3fce6b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:47.820704 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-39cf3198-131d-45c7-af78-e6050a3fce6b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:47.821127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-39cf3198-131d-45c7-af78-e6050a3fce6b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:47.825052 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:47.960789 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-39cf3198-131d-45c7-af78-e6050a3fce6b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:47.968785 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-39cf3198-131d-45c7-af78-e6050a3fce6b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1266 microversion: 2.1 time: 0.161862 Sep 13 03:32:47.969558 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 548/1131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:47 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:48.522702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-95cc91c1-6ba4-4e43-9252-27a39e3ddd7b req-50f8e418-1322-4685-bc59-d84eddf44661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e452a83d-d2f5-4167-89b8-f02e61173b84", "name": "network-vif-plugged", "status": "completed", "tag": "5eb326a8-8417-4b1c-a306-3720fd092e50"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:32:48.531794 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-95cc91c1-6ba4-4e43-9252-27a39e3ddd7b req-50f8e418-1322-4685-bc59-d84eddf44661 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:48.532269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-95cc91c1-6ba4-4e43-9252-27a39e3ddd7b req-50f8e418-1322-4685-bc59-d84eddf44661 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:48.532873 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-95cc91c1-6ba4-4e43-9252-27a39e3ddd7b req-50f8e418-1322-4685-bc59-d84eddf44661 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:48.543705 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-95cc91c1-6ba4-4e43-9252-27a39e3ddd7b req-50f8e418-1322-4685-bc59-d84eddf44661 service nova] Creating event network-vif-plugged:5eb326a8-8417-4b1c-a306-3720fd092e50 for instance e452a83d-d2f5-4167-89b8-f02e61173b84 on hv-cinder-85707 Sep 13 03:32:48.549157 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-95cc91c1-6ba4-4e43-9252-27a39e3ddd7b req-50f8e418-1322-4685-bc59-d84eddf44661 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222659 Sep 13 03:32:48.550104 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 584/1132] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:32:48.991287 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7f081114-a579-447f-a58a-9dcf1226247e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:48.991896 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7f081114-a579-447f-a58a-9dcf1226247e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:48.998221 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f081114-a579-447f-a58a-9dcf1226247e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:48.998775 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f081114-a579-447f-a58a-9dcf1226247e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:48.999192 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f081114-a579-447f-a58a-9dcf1226247e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:48.999874 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f081114-a579-447f-a58a-9dcf1226247e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:49.000323 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f081114-a579-447f-a58a-9dcf1226247e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:49.000739 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7f081114-a579-447f-a58a-9dcf1226247e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:49.139642 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7f081114-a579-447f-a58a-9dcf1226247e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:49.147666 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7f081114-a579-447f-a58a-9dcf1226247e tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1266 microversion: 2.1 time: 0.160163 Sep 13 03:32:49.148237 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 549/1133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:48 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:50.171675 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b358ff16-8c87-434b-b287-e6a5f30ba253 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:50.172340 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b358ff16-8c87-434b-b287-e6a5f30ba253 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:50.179051 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b358ff16-8c87-434b-b287-e6a5f30ba253 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:50.179538 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b358ff16-8c87-434b-b287-e6a5f30ba253 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:50.179976 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b358ff16-8c87-434b-b287-e6a5f30ba253 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:50.180666 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b358ff16-8c87-434b-b287-e6a5f30ba253 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:50.181153 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b358ff16-8c87-434b-b287-e6a5f30ba253 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:50.181579 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b358ff16-8c87-434b-b287-e6a5f30ba253 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:50.311995 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b358ff16-8c87-434b-b287-e6a5f30ba253 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:50.319774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b358ff16-8c87-434b-b287-e6a5f30ba253 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1266 microversion: 2.1 time: 0.152370 Sep 13 03:32:50.320344 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 585/1134] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:50 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:51.343341 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c0470ef2-5337-4df8-898b-92928b939a46 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:51.344069 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c0470ef2-5337-4df8-898b-92928b939a46 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:51.350639 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c0470ef2-5337-4df8-898b-92928b939a46 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:51.351120 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c0470ef2-5337-4df8-898b-92928b939a46 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:51.351552 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c0470ef2-5337-4df8-898b-92928b939a46 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:51.352231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c0470ef2-5337-4df8-898b-92928b939a46 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:51.352681 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c0470ef2-5337-4df8-898b-92928b939a46 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:51.353117 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c0470ef2-5337-4df8-898b-92928b939a46 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:51.482805 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c0470ef2-5337-4df8-898b-92928b939a46 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:51.490348 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c0470ef2-5337-4df8-898b-92928b939a46 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1452 microversion: 2.1 time: 0.150862 Sep 13 03:32:51.490943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 550/1135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:51 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:51.511850 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0c931ae4-0497-4021-88a1-406ca04bf286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:51.512474 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0c931ae4-0497-4021-88a1-406ca04bf286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:51.519738 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0c931ae4-0497-4021-88a1-406ca04bf286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:51.520225 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0c931ae4-0497-4021-88a1-406ca04bf286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:51.520665 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0c931ae4-0497-4021-88a1-406ca04bf286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:51.521355 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0c931ae4-0497-4021-88a1-406ca04bf286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:51.521810 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0c931ae4-0497-4021-88a1-406ca04bf286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:51.522238 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0c931ae4-0497-4021-88a1-406ca04bf286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:51.651443 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-0c931ae4-0497-4021-88a1-406ca04bf286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:32:51.654959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=100 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:51.660250 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0c931ae4-0497-4021-88a1-406ca04bf286 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1452 microversion: 2.1 time: 0.152219 Sep 13 03:32:51.660815 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 586/1136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:32:51 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:32:53.387715 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-eb762405-75d9-45b7-8536-78e712bb3e30 req-47e03428-68a7-47cb-ad18-bcdf40bdfc79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e452a83d-d2f5-4167-89b8-f02e61173b84", "tag": "5eb326a8-8417-4b1c-a306-3720fd092e50"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:32:53.402823 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-eb762405-75d9-45b7-8536-78e712bb3e30 req-47e03428-68a7-47cb-ad18-bcdf40bdfc79 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:53.403832 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-eb762405-75d9-45b7-8536-78e712bb3e30 req-47e03428-68a7-47cb-ad18-bcdf40bdfc79 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:53.404478 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-eb762405-75d9-45b7-8536-78e712bb3e30 req-47e03428-68a7-47cb-ad18-bcdf40bdfc79 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:53.422346 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-eb762405-75d9-45b7-8536-78e712bb3e30 req-47e03428-68a7-47cb-ad18-bcdf40bdfc79 service nova] Creating event network-changed:5eb326a8-8417-4b1c-a306-3720fd092e50 for instance e452a83d-d2f5-4167-89b8-f02e61173b84 on hv-cinder-85707 Sep 13 03:32:53.428424 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-eb762405-75d9-45b7-8536-78e712bb3e30 req-47e03428-68a7-47cb-ad18-bcdf40bdfc79 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045966 Sep 13 03:32:53.429018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 551/1137] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:32:53.990890 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-43d09522-349f-435f-b3d4-c8f00f556cd2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:32:53.991380 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-43d09522-349f-435f-b3d4-c8f00f556cd2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:53.997394 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-43d09522-349f-435f-b3d4-c8f00f556cd2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:53.998107 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-43d09522-349f-435f-b3d4-c8f00f556cd2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:53.998751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-43d09522-349f-435f-b3d4-c8f00f556cd2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:53.999469 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-43d09522-349f-435f-b3d4-c8f00f556cd2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:53.999908 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-43d09522-349f-435f-b3d4-c8f00f556cd2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:54.000531 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-43d09522-349f-435f-b3d4-c8f00f556cd2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:54.024339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-43d09522-349f-435f-b3d4-c8f00f556cd2 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/ips" status: 200 len: 151 microversion: 2.1 time: 0.262485 Sep 13 03:32:54.025153 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 587/1138] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 03:32:53 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/ips => generated 151 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:32:55.422965 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5c9caf67-70d6-4ad8-a29a-e905a784acf3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f1bbc60-6d39-45cc-ac46-e26efa4cc140"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:32:55.426675 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5c9caf67-70d6-4ad8-a29a-e905a784acf3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:32:55.434171 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c9caf67-70d6-4ad8-a29a-e905a784acf3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:55.434671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c9caf67-70d6-4ad8-a29a-e905a784acf3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:55.435104 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c9caf67-70d6-4ad8-a29a-e905a784acf3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:55.435798 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c9caf67-70d6-4ad8-a29a-e905a784acf3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:32:55.436250 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c9caf67-70d6-4ad8-a29a-e905a784acf3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:32:55.436668 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5c9caf67-70d6-4ad8-a29a-e905a784acf3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:32:55.711906 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5c9caf67-70d6-4ad8-a29a-e905a784acf3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "POST /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293035 Sep 13 03:32:55.718380 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 552/1139] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 03:32:55 2022] POST /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:33:04.416102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-18436502-250d-4f43-9c7f-d1fdfd2c48e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:04.416606 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-18436502-250d-4f43-9c7f-d1fdfd2c48e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:04.418826 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=42 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:04.419503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=4 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:04.425514 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18436502-250d-4f43-9c7f-d1fdfd2c48e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:04.426004 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18436502-250d-4f43-9c7f-d1fdfd2c48e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:04.426448 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18436502-250d-4f43-9c7f-d1fdfd2c48e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:04.427176 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18436502-250d-4f43-9c7f-d1fdfd2c48e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:04.427637 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18436502-250d-4f43-9c7f-d1fdfd2c48e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:04.428067 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-18436502-250d-4f43-9c7f-d1fdfd2c48e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:04.507519 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-18436502-250d-4f43-9c7f-d1fdfd2c48e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lazy-loading 'services' on Instance uuid 0c95dd15-e568-4147-b1ef-6ea16581ed20 {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:33:04.589107 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-18436502-250d-4f43-9c7f-d1fdfd2c48e8 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/os-volume_attachments/3f1bbc60-6d39-45cc-ac46-e26efa4cc140" status: 202 len: 0 microversion: 2.1 time: 0.176954 Sep 13 03:33:04.589826 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 588/1140] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 03:33:04 2022] DELETE /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/os-volume_attachments/3f1bbc60-6d39-45cc-ac46-e26efa4cc140 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:33:04.600109 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9a910f06-2f86-4cba-ac84-fe5435be8281 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:04.602359 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-9a910f06-2f86-4cba-ac84-fe5435be8281 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:04.604330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:04.611675 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9a910f06-2f86-4cba-ac84-fe5435be8281 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:04.612171 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9a910f06-2f86-4cba-ac84-fe5435be8281 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:04.612848 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9a910f06-2f86-4cba-ac84-fe5435be8281 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:04.613510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9a910f06-2f86-4cba-ac84-fe5435be8281 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:04.613894 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9a910f06-2f86-4cba-ac84-fe5435be8281 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:04.614349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-9a910f06-2f86-4cba-ac84-fe5435be8281 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:04.648700 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9a910f06-2f86-4cba-ac84-fe5435be8281 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053442 Sep 13 03:33:04.649251 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 553/1141] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:33:04 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:05.662916 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f5f07091-966b-44ec-b5f1-f2f350bff807 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:05.665371 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f5f07091-966b-44ec-b5f1-f2f350bff807 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:05.671716 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f5f07091-966b-44ec-b5f1-f2f350bff807 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:05.672290 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f5f07091-966b-44ec-b5f1-f2f350bff807 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:05.672737 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f5f07091-966b-44ec-b5f1-f2f350bff807 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:05.673442 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f5f07091-966b-44ec-b5f1-f2f350bff807 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:05.673901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f5f07091-966b-44ec-b5f1-f2f350bff807 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:05.674333 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f5f07091-966b-44ec-b5f1-f2f350bff807 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:05.706590 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f5f07091-966b-44ec-b5f1-f2f350bff807 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048826 Sep 13 03:33:05.707188 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 589/1142] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:33:05 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:06.719068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-63fb81cb-fffa-4727-b417-4d3c9bd566b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:06.721212 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-63fb81cb-fffa-4727-b417-4d3c9bd566b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:06.727592 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-63fb81cb-fffa-4727-b417-4d3c9bd566b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:06.728070 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-63fb81cb-fffa-4727-b417-4d3c9bd566b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:06.728504 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-63fb81cb-fffa-4727-b417-4d3c9bd566b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:06.729183 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-63fb81cb-fffa-4727-b417-4d3c9bd566b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:06.729634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-63fb81cb-fffa-4727-b417-4d3c9bd566b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:06.730053 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-63fb81cb-fffa-4727-b417-4d3c9bd566b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:06.761165 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-63fb81cb-fffa-4727-b417-4d3c9bd566b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046014 Sep 13 03:33:06.761727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 554/1143] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:33:06 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 03:33:06.826033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-632362e2-25aa-496f-aea5-7aa192af1ee3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:06.826509 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-632362e2-25aa-496f-aea5-7aa192af1ee3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:06.832819 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-632362e2-25aa-496f-aea5-7aa192af1ee3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:06.833298 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-632362e2-25aa-496f-aea5-7aa192af1ee3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:06.833730 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-632362e2-25aa-496f-aea5-7aa192af1ee3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:06.834410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-632362e2-25aa-496f-aea5-7aa192af1ee3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:06.834895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-632362e2-25aa-496f-aea5-7aa192af1ee3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:06.835314 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-632362e2-25aa-496f-aea5-7aa192af1ee3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:06.862013 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-632362e2-25aa-496f-aea5-7aa192af1ee3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Going to try to terminate instance {{(pid=120383) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:33:06.939033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-632362e2-25aa-496f-aea5-7aa192af1ee3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 204 len: 0 microversion: 2.1 time: 0.116652 Sep 13 03:33:06.939748 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 590/1144] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:33:06 2022] DELETE /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:33:06.948586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e245b704-33fd-4e13-9abe-45fe1ea0e496 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:06.949201 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e245b704-33fd-4e13-9abe-45fe1ea0e496 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:06.955051 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e245b704-33fd-4e13-9abe-45fe1ea0e496 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:06.955532 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e245b704-33fd-4e13-9abe-45fe1ea0e496 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:06.955966 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e245b704-33fd-4e13-9abe-45fe1ea0e496 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:06.956720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e245b704-33fd-4e13-9abe-45fe1ea0e496 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:06.957207 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e245b704-33fd-4e13-9abe-45fe1ea0e496 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:06.957633 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e245b704-33fd-4e13-9abe-45fe1ea0e496 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:07.089952 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-e245b704-33fd-4e13-9abe-45fe1ea0e496 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:07.098165 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e245b704-33fd-4e13-9abe-45fe1ea0e496 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1683 microversion: 2.1 time: 0.153743 Sep 13 03:33:07.098750 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 555/1145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:33:06 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:33:08.122731 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5fefff2a-2ae9-4913-baec-a1d4bab722d6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:08.123460 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5fefff2a-2ae9-4913-baec-a1d4bab722d6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:08.130237 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5fefff2a-2ae9-4913-baec-a1d4bab722d6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:08.130740 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5fefff2a-2ae9-4913-baec-a1d4bab722d6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:08.131173 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5fefff2a-2ae9-4913-baec-a1d4bab722d6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:08.131852 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5fefff2a-2ae9-4913-baec-a1d4bab722d6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:08.132303 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5fefff2a-2ae9-4913-baec-a1d4bab722d6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:08.132718 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5fefff2a-2ae9-4913-baec-a1d4bab722d6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:08.258946 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5fefff2a-2ae9-4913-baec-a1d4bab722d6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:08.266477 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5fefff2a-2ae9-4913-baec-a1d4bab722d6 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1683 microversion: 2.1 time: 0.148009 Sep 13 03:33:08.267072 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 591/1146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:33:08 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:33:09.288833 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7d7dbf18-dedf-4cd3-afeb-9ebaad8b6549 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:09.289453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7d7dbf18-dedf-4cd3-afeb-9ebaad8b6549 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:09.295875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7d7dbf18-dedf-4cd3-afeb-9ebaad8b6549 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:09.296368 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7d7dbf18-dedf-4cd3-afeb-9ebaad8b6549 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:09.296810 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7d7dbf18-dedf-4cd3-afeb-9ebaad8b6549 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:09.298118 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7d7dbf18-dedf-4cd3-afeb-9ebaad8b6549 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:09.298577 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7d7dbf18-dedf-4cd3-afeb-9ebaad8b6549 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:09.299035 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7d7dbf18-dedf-4cd3-afeb-9ebaad8b6549 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:09.426903 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-7d7dbf18-dedf-4cd3-afeb-9ebaad8b6549 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:09.434644 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7d7dbf18-dedf-4cd3-afeb-9ebaad8b6549 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1683 microversion: 2.1 time: 0.149951 Sep 13 03:33:09.435210 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 556/1147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:33:09 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:33:10.457555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e7e53773-7e51-41f6-8230-3f0e115e15b5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:10.458173 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e7e53773-7e51-41f6-8230-3f0e115e15b5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:10.464604 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e7e53773-7e51-41f6-8230-3f0e115e15b5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:10.465090 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e7e53773-7e51-41f6-8230-3f0e115e15b5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:10.465527 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e7e53773-7e51-41f6-8230-3f0e115e15b5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:10.466269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e7e53773-7e51-41f6-8230-3f0e115e15b5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:10.466748 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e7e53773-7e51-41f6-8230-3f0e115e15b5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:10.467171 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e7e53773-7e51-41f6-8230-3f0e115e15b5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:10.696313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e7e53773-7e51-41f6-8230-3f0e115e15b5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:10.704035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e7e53773-7e51-41f6-8230-3f0e115e15b5 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1683 microversion: 2.1 time: 0.250427 Sep 13 03:33:10.704603 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 592/1148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:33:10 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1683 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:33:11.075237 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-0566b798-f753-4f8d-82da-d04d39e9c5e1 req-713de607-aec9-412b-8616-ad3bd2661870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c95dd15-e568-4147-b1ef-6ea16581ed20", "name": "network-vif-deleted", "tag": "58571e1d-dcfb-427e-802d-1adfb75720bc"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:33:11.085959 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-0566b798-f753-4f8d-82da-d04d39e9c5e1 req-713de607-aec9-412b-8616-ad3bd2661870 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:11.086831 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-0566b798-f753-4f8d-82da-d04d39e9c5e1 req-713de607-aec9-412b-8616-ad3bd2661870 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:11.087272 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-0566b798-f753-4f8d-82da-d04d39e9c5e1 req-713de607-aec9-412b-8616-ad3bd2661870 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:11.098385 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-0566b798-f753-4f8d-82da-d04d39e9c5e1 req-713de607-aec9-412b-8616-ad3bd2661870 service nova] Creating event network-vif-deleted:58571e1d-dcfb-427e-802d-1adfb75720bc for instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 on hv-cinder-85707 Sep 13 03:33:11.103460 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-0566b798-f753-4f8d-82da-d04d39e9c5e1 req-713de607-aec9-412b-8616-ad3bd2661870 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031882 Sep 13 03:33:11.104176 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 557/1149] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:11.727886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:11.728488 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:11.735696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:11.736182 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:11.736614 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:11.737308 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:11.737788 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:11.738203 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:11.770498 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:11.771007 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:11.771439 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:11.771879 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lazy-loading 'fault' on Instance uuid 0c95dd15-e568-4147-b1ef-6ea16581ed20 {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:33:11.815335 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f76a7c6fe9347b0bea5f701bccb6150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676c9aac6fa348b89a2d5cef106f1a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:11.823645 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-eecd3849-30fb-492c-9329-53fd6ef327e3 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 200 len: 1331 microversion: 2.1 time: 0.099556 Sep 13 03:33:11.824221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 593/1150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:33:11 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:33:12.848948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7858be98-d8d4-461b-87a5-f664f9e97eff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:12.849695 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7858be98-d8d4-461b-87a5-f664f9e97eff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:12.855801 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7858be98-d8d4-461b-87a5-f664f9e97eff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:12.856288 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7858be98-d8d4-461b-87a5-f664f9e97eff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:12.856723 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7858be98-d8d4-461b-87a5-f664f9e97eff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:12.857418 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7858be98-d8d4-461b-87a5-f664f9e97eff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:12.857869 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7858be98-d8d4-461b-87a5-f664f9e97eff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:12.858303 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7858be98-d8d4-461b-87a5-f664f9e97eff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:12.871314 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-7858be98-d8d4-461b-87a5-f664f9e97eff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7858be98-d8d4-461b-87a5-f664f9e97eff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 HTTP/1.1 Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:33:12.872930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:33:12.874514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:33:12.874514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:12.874514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:12.874514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:12.874514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:12.874514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:33:12.874514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:33:12.874514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:33:12.874514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:12.874514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:33:12.874514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:12.874514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': '0c95dd15-e568-4147-b1ef-6ea16581ed20'} Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:12.876013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:12.877588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:12.879130 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7858be98-d8d4-461b-87a5-f664f9e97eff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 404 to user: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:12.879130 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7858be98-d8d4-461b-87a5-f664f9e97eff tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 404 len: 111 microversion: 2.1 time: 0.030951 Sep 13 03:33:12.879130 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 558/1151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:33:12 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:33:12.883717 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-55a672bb-d35c-44c3-9a78-f19fb0134d0b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '.version_select at 0x7f89357da820>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:12.902851 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-55a672bb-d35c-44c3-9a78-f19fb0134d0b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1948437372" status: 202 len: 0 microversion: 2.1 time: 0.022861 Sep 13 03:33:12.903408 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 594/1152] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Sep 13 03:33:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1948437372 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:33:14.631472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-18e51893-8ed8-496d-88f4-df0294eb6800 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:14.632012 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-18e51893-8ed8-496d-88f4-df0294eb6800 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:14.638277 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-18e51893-8ed8-496d-88f4-df0294eb6800 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:14.638793 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-18e51893-8ed8-496d-88f4-df0294eb6800 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:14.639225 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-18e51893-8ed8-496d-88f4-df0294eb6800 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:14.639910 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-18e51893-8ed8-496d-88f4-df0294eb6800 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:14.640363 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-18e51893-8ed8-496d-88f4-df0294eb6800 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:14.641386 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-18e51893-8ed8-496d-88f4-df0294eb6800 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:14.655140 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-18e51893-8ed8-496d-88f4-df0294eb6800 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-18e51893-8ed8-496d-88f4-df0294eb6800 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: DELETE /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 HTTP/1.1 Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:33:14.656727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:33:14.658318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:33:14.658318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:14.658318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:14.658318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:14.658318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:14.658318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:33:14.658318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:33:14.658318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:33:14.658318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:14.658318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:33:14.658318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:14.658318 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': '0c95dd15-e568-4147-b1ef-6ea16581ed20'} Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:14.659350 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:14.660866 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:14.663015 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-18e51893-8ed8-496d-88f4-df0294eb6800 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 404 to user: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:14.663015 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-18e51893-8ed8-496d-88f4-df0294eb6800 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 404 len: 111 microversion: 2.1 time: 0.030458 Sep 13 03:33:14.663015 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 559/1153] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:33:14 2022] DELETE /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:33:14.667330 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-46091d28-65c9-4931-a164-4c1ffc2de4f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:14.667939 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-46091d28-65c9-4931-a164-4c1ffc2de4f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 0c95dd15-e568-4147-b1ef-6ea16581ed20] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:14.674349 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-46091d28-65c9-4931-a164-4c1ffc2de4f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:14.674849 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-46091d28-65c9-4931-a164-4c1ffc2de4f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:14.675279 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-46091d28-65c9-4931-a164-4c1ffc2de4f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:14.675956 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-46091d28-65c9-4931-a164-4c1ffc2de4f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:14.676406 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-46091d28-65c9-4931-a164-4c1ffc2de4f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:14.676824 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-46091d28-65c9-4931-a164-4c1ffc2de4f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:14.689951 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-46091d28-65c9-4931-a164-4c1ffc2de4f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-46091d28-65c9-4931-a164-4c1ffc2de4f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 HTTP/1.1 Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:33:14.691576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:33:14.693254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:33:14.693254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:14.693254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:14.693254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:14.693254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:14.693254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:33:14.693254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:33:14.693254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:33:14.693254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:14.693254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:33:14.693254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:14.693254 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': '0c95dd15-e568-4147-b1ef-6ea16581ed20'} Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:14.694377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. Sep 13 03:33:14.695966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:14.697492 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-46091d28-65c9-4931-a164-4c1ffc2de4f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 404 to user: Instance 0c95dd15-e568-4147-b1ef-6ea16581ed20 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:14.697492 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-46091d28-65c9-4931-a164-4c1ffc2de4f4 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20" status: 404 len: 111 microversion: 2.1 time: 0.030005 Sep 13 03:33:14.697492 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 595/1154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:33:14 2022] GET /compute/v2.1/servers/0c95dd15-e568-4147-b1ef-6ea16581ed20 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 03:33:15.828195 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7659eaab-ea2a-43c8-bf83-c4bafa205a53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:15.829188 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7659eaab-ea2a-43c8-bf83-c4bafa205a53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:15.835514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7659eaab-ea2a-43c8-bf83-c4bafa205a53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:15.836004 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7659eaab-ea2a-43c8-bf83-c4bafa205a53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:15.836443 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7659eaab-ea2a-43c8-bf83-c4bafa205a53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:15.837136 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7659eaab-ea2a-43c8-bf83-c4bafa205a53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:15.837592 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7659eaab-ea2a-43c8-bf83-c4bafa205a53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:15.838021 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7659eaab-ea2a-43c8-bf83-c4bafa205a53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:15.851801 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-7659eaab-ea2a-43c8-bf83-c4bafa205a53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7659eaab-ea2a-43c8-bf83-c4bafa205a53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: DELETE /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 HTTP/1.1 Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:33:15.853327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:33:15.854908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:33:15.854908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:15.854908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:15.854908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:15.854908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:15.854908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:33:15.854908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:33:15.854908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:33:15.854908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:15.854908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:33:15.854908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:33:15.854908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': 'd0446c67-3992-4af8-9863-0eed6088d0a7'} Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:15.855670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:33:15.856947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.858230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7659eaab-ea2a-43c8-bf83-c4bafa205a53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 404 to user: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:15.858230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7659eaab-ea2a-43c8-bf83-c4bafa205a53 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 404 len: 111 microversion: 2.1 time: 0.030336 Sep 13 03:33:15.858230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 560/1155] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:33:15 2022] DELETE /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:33:15.863401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-08a25f6a-3b90-4b93-a69e-819d45277d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:15.864087 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-08a25f6a-3b90-4b93-a69e-819d45277d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: d0446c67-3992-4af8-9863-0eed6088d0a7] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:15.872299 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-08a25f6a-3b90-4b93-a69e-819d45277d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:15.872794 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-08a25f6a-3b90-4b93-a69e-819d45277d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:15.873231 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-08a25f6a-3b90-4b93-a69e-819d45277d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:15.873937 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-08a25f6a-3b90-4b93-a69e-819d45277d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:15.874395 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-08a25f6a-3b90-4b93-a69e-819d45277d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:15.874865 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-08a25f6a-3b90-4b93-a69e-819d45277d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:15.888634 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-08a25f6a-3b90-4b93-a69e-819d45277d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-08a25f6a-3b90-4b93-a69e-819d45277d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 HTTP/1.1 Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:33:15.890151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:33:15.892508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:33:15.892508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:15.892508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:15.892508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:15.892508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:15.892508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:33:15.892508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:33:15.892508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:33:15.892508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:15.892508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:33:15.892508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:33:15.892508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'd0446c67-3992-4af8-9863-0eed6088d0a7'} Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:15.893397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. Sep 13 03:33:15.894887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.896191 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-08a25f6a-3b90-4b93-a69e-819d45277d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 404 to user: Instance d0446c67-3992-4af8-9863-0eed6088d0a7 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:15.896191 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-08a25f6a-3b90-4b93-a69e-819d45277d01 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7" status: 404 len: 111 microversion: 2.1 time: 0.032606 Sep 13 03:33:15.896191 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 596/1156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:33:15 2022] GET /compute/v2.1/servers/d0446c67-3992-4af8-9863-0eed6088d0a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 03:33:15.900870 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-485e31f3-ab8d-40ac-8032-a22f9c0bbd1b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:15.901374 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-485e31f3-ab8d-40ac-8032-a22f9c0bbd1b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:15.907627 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-485e31f3-ab8d-40ac-8032-a22f9c0bbd1b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:15.908119 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-485e31f3-ab8d-40ac-8032-a22f9c0bbd1b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:15.908561 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-485e31f3-ab8d-40ac-8032-a22f9c0bbd1b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:15.909257 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-485e31f3-ab8d-40ac-8032-a22f9c0bbd1b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:15.909745 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-485e31f3-ab8d-40ac-8032-a22f9c0bbd1b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:15.910174 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-485e31f3-ab8d-40ac-8032-a22f9c0bbd1b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:15.925335 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-485e31f3-ab8d-40ac-8032-a22f9c0bbd1b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-485e31f3-ab8d-40ac-8032-a22f9c0bbd1b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: DELETE /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 HTTP/1.1 Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:33:15.926888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:33:15.928510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:33:15.928510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:15.928510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:15.928510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:15.928510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:15.928510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:33:15.928510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:33:15.928510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:33:15.928510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:15.928510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:33:15.928510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:33:15.928510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': '2620476c-6af0-419c-9d61-aeb1d1ee1457'} Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:15.929472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:33:15.930961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.932443 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-485e31f3-ab8d-40ac-8032-a22f9c0bbd1b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 404 to user: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:15.932443 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-485e31f3-ab8d-40ac-8032-a22f9c0bbd1b tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 404 len: 111 microversion: 2.1 time: 0.031282 Sep 13 03:33:15.932443 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 561/1157] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:33:15 2022] DELETE /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 03:33:15.936442 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cec724c0-4720-4ea6-842e-d3ff84a272b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:15.937060 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-cec724c0-4720-4ea6-842e-d3ff84a272b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: 2620476c-6af0-419c-9d61-aeb1d1ee1457] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:15.943493 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cec724c0-4720-4ea6-842e-d3ff84a272b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:15.943975 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cec724c0-4720-4ea6-842e-d3ff84a272b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:15.944413 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cec724c0-4720-4ea6-842e-d3ff84a272b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:15.945109 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cec724c0-4720-4ea6-842e-d3ff84a272b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:15.945566 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cec724c0-4720-4ea6-842e-d3ff84a272b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:15.945992 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-cec724c0-4720-4ea6-842e-d3ff84a272b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:15.959702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-cec724c0-4720-4ea6-842e-d3ff84a272b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cec724c0-4720-4ea6-842e-d3ff84a272b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 HTTP/1.1 Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:33:15.961205 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:33:15.962763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:33:15.962763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:15.962763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:15.962763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:15.962763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:15.962763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:33:15.962763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:33:15.962763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:33:15.962763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:15.962763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:33:15.962763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:33:15.962763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': '2620476c-6af0-419c-9d61-aeb1d1ee1457'} Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:15.963618 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. Sep 13 03:33:15.964806 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:15.965877 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-cec724c0-4720-4ea6-842e-d3ff84a272b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 404 to user: Instance 2620476c-6af0-419c-9d61-aeb1d1ee1457 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:15.965877 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-cec724c0-4720-4ea6-842e-d3ff84a272b1 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457" status: 404 len: 111 microversion: 2.1 time: 0.029893 Sep 13 03:33:15.965877 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 597/1158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:33:15 2022] GET /compute/v2.1/servers/2620476c-6af0-419c-9d61-aeb1d1ee1457 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:33:18.160382 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-33316ea0-cc79-420b-8856-4c5009336cf0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:18.160900 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-33316ea0-cc79-420b-8856-4c5009336cf0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:18.167479 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-33316ea0-cc79-420b-8856-4c5009336cf0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:18.167957 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-33316ea0-cc79-420b-8856-4c5009336cf0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:18.168386 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-33316ea0-cc79-420b-8856-4c5009336cf0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:18.169068 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-33316ea0-cc79-420b-8856-4c5009336cf0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:18.169515 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-33316ea0-cc79-420b-8856-4c5009336cf0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:18.169933 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-33316ea0-cc79-420b-8856-4c5009336cf0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:18.173844 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:18.184038 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-33316ea0-cc79-420b-8856-4c5009336cf0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-33316ea0-cc79-420b-8856-4c5009336cf0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: DELETE /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 HTTP/1.1 Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:33:18.185628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:33:18.187367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:33:18.187367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:18.187367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:18.187367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:18.187367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:18.187367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:33:18.187367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:33:18.187367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:33:18.187367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:18.187367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:33:18.187367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:33:18.187367 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': 'dab865ad-8ee0-4def-a996-caa5e4e30f30'} Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:18.188784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:33:18.190349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:18.191934 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-33316ea0-cc79-420b-8856-4c5009336cf0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 404 to user: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:18.191934 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-33316ea0-cc79-420b-8856-4c5009336cf0 tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 404 len: 111 microversion: 2.1 time: 0.030474 Sep 13 03:33:18.191934 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 562/1159] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:33:18 2022] DELETE /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:33:18.196071 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8055cf64-afa7-48c9-aaad-6e4eff35c42a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:18.196681 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8055cf64-afa7-48c9-aaad-6e4eff35c42a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] [instance: dab865ad-8ee0-4def-a996-caa5e4e30f30] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:18.203058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8055cf64-afa7-48c9-aaad-6e4eff35c42a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:18.204201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8055cf64-afa7-48c9-aaad-6e4eff35c42a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:18.204636 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8055cf64-afa7-48c9-aaad-6e4eff35c42a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:18.205321 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8055cf64-afa7-48c9-aaad-6e4eff35c42a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:18.205763 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8055cf64-afa7-48c9-aaad-6e4eff35c42a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:18.206178 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8055cf64-afa7-48c9-aaad-6e4eff35c42a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:18.219911 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-8055cf64-afa7-48c9-aaad-6e4eff35c42a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] HTTP exception thrown: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8055cf64-afa7-48c9-aaad-6e4eff35c42a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Request method failure captured: Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 HTTP/1.1 Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cm33zVmZ4WPzdy7wuuMZzyVo3s3miOVOb7Swm8eAwoF3RF3yaHGNYsXWQPIOLpBMd_avBmtMKDWLHt3RsLsTVt3FQYvkkj85l00Qa4ya0hKLVZKFEtLrvk-xY7qhJfb0afzLXc2qryTnvVHdz-tNiYVYbxZEAVs2N3pC7ob4xm8TE Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:33:18.221419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:33:18.223141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676c9aac6fa348b89a2d5cef106f1a74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676c9aac6fa348b89a2d5cef106f1a74"}]}] Sep 13 03:33:18.223141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:18.223141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 676c9aac6fa348b89a2d5cef106f1a74 Sep 13 03:33:18.223141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2081411953 Sep 13 03:33:18.223141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:18.223141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:33:18.223141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:33:18.223141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 4f76a7c6fe9347b0bea5f701bccb6150 Sep 13 03:33:18.223141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-AttachVolumeNegativeTest-2081411953-project Sep 13 03:33:18.223141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:33:18.223141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:33:18.223141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'dab865ad-8ee0-4def-a996-caa5e4e30f30'} Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:18.224035 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. Sep 13 03:33:18.225503 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:18.226933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8055cf64-afa7-48c9-aaad-6e4eff35c42a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] Returning 404 to user: Instance dab865ad-8ee0-4def-a996-caa5e4e30f30 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:18.226933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8055cf64-afa7-48c9-aaad-6e4eff35c42a tempest-AttachVolumeNegativeTest-2081411953 tempest-AttachVolumeNegativeTest-2081411953-project] 10.222.0.18 "GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30" status: 404 len: 111 microversion: 2.1 time: 0.030710 Sep 13 03:33:18.226933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 598/1160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:33:18 2022] GET /compute/v2.1/servers/dab865ad-8ee0-4def-a996-caa5e4e30f30 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:33:21.226646 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-bd8d77b6-636d-4f05-88c2-37e16c853af1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:21.231005 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-bd8d77b6-636d-4f05-88c2-37e16c853af1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:21.239893 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bd8d77b6-636d-4f05-88c2-37e16c853af1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:21.240385 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bd8d77b6-636d-4f05-88c2-37e16c853af1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:21.241062 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bd8d77b6-636d-4f05-88c2-37e16c853af1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:21.241952 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bd8d77b6-636d-4f05-88c2-37e16c853af1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:21.242563 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bd8d77b6-636d-4f05-88c2-37e16c853af1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:21.243511 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bd8d77b6-636d-4f05-88c2-37e16c853af1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:21.279457 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-bd8d77b6-636d-4f05-88c2-37e16c853af1 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057448 Sep 13 03:33:21.280663 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 563/1161] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 13 03:33:21 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:33:21.355175 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3fd77782-41c1-4678-ac31-9ea7663ab659 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:21.355796 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3fd77782-41c1-4678-ac31-9ea7663ab659 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:21.367992 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3fd77782-41c1-4678-ac31-9ea7663ab659 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:21.368496 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3fd77782-41c1-4678-ac31-9ea7663ab659 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:21.369329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3fd77782-41c1-4678-ac31-9ea7663ab659 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:21.369653 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3fd77782-41c1-4678-ac31-9ea7663ab659 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:21.371884 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3fd77782-41c1-4678-ac31-9ea7663ab659 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:21.372336 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3fd77782-41c1-4678-ac31-9ea7663ab659 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:21.409378 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3fd77782-41c1-4678-ac31-9ea7663ab659 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Going to try to terminate instance {{(pid=120383) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:33:21.557957 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3fd77782-41c1-4678-ac31-9ea7663ab659 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 204 len: 0 microversion: 2.20 time: 0.205343 Sep 13 03:33:21.564718 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 599/1162] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Sep 13 03:33:21 2022] DELETE /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 03:33:21.571442 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ed6490ce-3cb4-41db-b89f-72abfb284ea9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:21.572057 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ed6490ce-3cb4-41db-b89f-72abfb284ea9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:21.578131 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ed6490ce-3cb4-41db-b89f-72abfb284ea9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:21.578645 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ed6490ce-3cb4-41db-b89f-72abfb284ea9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:21.579135 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ed6490ce-3cb4-41db-b89f-72abfb284ea9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:21.579834 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ed6490ce-3cb4-41db-b89f-72abfb284ea9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:21.580285 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ed6490ce-3cb4-41db-b89f-72abfb284ea9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:21.580896 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ed6490ce-3cb4-41db-b89f-72abfb284ea9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:21.745819 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ed6490ce-3cb4-41db-b89f-72abfb284ea9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:21.755074 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ed6490ce-3cb4-41db-b89f-72abfb284ea9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:21.756525 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ed6490ce-3cb4-41db-b89f-72abfb284ea9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:21.757688 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ed6490ce-3cb4-41db-b89f-72abfb284ea9 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.194745 Sep 13 03:33:21.758240 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 564/1163] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:33:21 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:33:22.737878 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-dc3dde25-c739-4950-8c86-9063d2f09e12 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Action: 'create', calling method: .version_select at 0x7f8935ac8280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1966957476"}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:33:22.782242 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-62a4075e-77f7-4653-b421-eadd32f780e3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:22.782882 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-62a4075e-77f7-4653-b421-eadd32f780e3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:22.789375 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-62a4075e-77f7-4653-b421-eadd32f780e3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:22.789868 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-62a4075e-77f7-4653-b421-eadd32f780e3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:22.790302 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-62a4075e-77f7-4653-b421-eadd32f780e3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:22.791016 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-62a4075e-77f7-4653-b421-eadd32f780e3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:22.791479 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-62a4075e-77f7-4653-b421-eadd32f780e3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:22.791869 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-62a4075e-77f7-4653-b421-eadd32f780e3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:22.938037 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-62a4075e-77f7-4653-b421-eadd32f780e3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:22.947503 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-62a4075e-77f7-4653-b421-eadd32f780e3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:22.949080 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-62a4075e-77f7-4653-b421-eadd32f780e3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:22.950332 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-62a4075e-77f7-4653-b421-eadd32f780e3 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.171971 Sep 13 03:33:22.951161 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 565/1164] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:33:22 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 03:33:23.046011 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-dc3dde25-c739-4950-8c86-9063d2f09e12 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.424901 Sep 13 03:33:23.046681 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 600/1165] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Sep 13 03:33:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 427 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 03:33:23.060031 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f81f992b-6df2-45c1-9744-7cf90cb8a29a tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f8935691ee0>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:23.109736 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f81f992b-6df2-45c1-9744-7cf90cb8a29a tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a" status: 200 len: 345 microversion: 2.1 time: 0.053684 Sep 13 03:33:23.110883 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 566/1166] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:33:23 2022] GET /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:23.977102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7a92bbd6-3f43-48a3-9ce5-5a4e33fd91b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:23.979187 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7a92bbd6-3f43-48a3-9ce5-5a4e33fd91b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:23.988237 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a92bbd6-3f43-48a3-9ce5-5a4e33fd91b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:23.988914 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a92bbd6-3f43-48a3-9ce5-5a4e33fd91b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:23.989592 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a92bbd6-3f43-48a3-9ce5-5a4e33fd91b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:23.990767 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a92bbd6-3f43-48a3-9ce5-5a4e33fd91b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:23.991377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a92bbd6-3f43-48a3-9ce5-5a4e33fd91b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:23.992133 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7a92bbd6-3f43-48a3-9ce5-5a4e33fd91b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:24.124783 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-645ee4d1-fd84-4b6c-bc73-71a9892d9520 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f8935b8e700>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:24.198152 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-645ee4d1-fd84-4b6c-bc73-71a9892d9520 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a" status: 200 len: 346 microversion: 2.1 time: 0.077050 Sep 13 03:33:24.198928 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 567/1167] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:33:24 2022] GET /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:33:24.213841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7a92bbd6-3f43-48a3-9ce5-5a4e33fd91b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:24.215339 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-06b9b8cc-53dd-48bf-9ccb-86343d9fe54d tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Action: 'create', calling method: .version_select at 0x7f8935aa1310>, body: {"snapshot": {"volume_id": "718b0caf-a0aa-4d73-86ba-5074da131c3a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-303193189"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:33:24.223108 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7a92bbd6-3f43-48a3-9ce5-5a4e33fd91b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:24.237459 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-7a92bbd6-3f43-48a3-9ce5-5a4e33fd91b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:24.238762 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7a92bbd6-3f43-48a3-9ce5-5a4e33fd91b4 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1721 microversion: 2.20 time: 0.267247 Sep 13 03:33:24.239215 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 601/1168] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:33:23 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:33:24.428231 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-06b9b8cc-53dd-48bf-9ccb-86343d9fe54d tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.217086 Sep 13 03:33:24.429087 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 568/1169] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Sep 13 03:33:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:24.442494 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-30552210-19d5-4c5a-8430-be173b9e7060 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f8935892550>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:24.473563 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-30552210-19d5-4c5a-8430-be173b9e7060 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 200 len: 286 microversion: 2.1 time: 0.036630 Sep 13 03:33:24.474130 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 602/1170] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:24 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:24.484806 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6dbbd549-1b91-4948-89db-92478080920c tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f89359004c0>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:24.516377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6dbbd549-1b91-4948-89db-92478080920c tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035144 Sep 13 03:33:24.517192 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 569/1171] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Sep 13 03:33:24 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:24.530213 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-9f98698b-0d63-4c2f-b544-1179962a8788 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f8935715a60>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:24.560176 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-9f98698b-0d63-4c2f-b544-1179962a8788 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 200 len: 286 microversion: 2.1 time: 0.033781 Sep 13 03:33:24.560829 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 603/1172] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:24 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:25.006215 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-1824617d-1655-4650-82b1-fbc2c6e299ba req-3b5569c5-3d94-4ca3-8d6e-90b2ac22a195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a712d2c4-a489-45e8-941a-13abba66403c", "name": "network-vif-deleted", "tag": "1b4bf2a7-2e87-4a14-894c-d018f847fb5b"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:33:25.017230 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-1824617d-1655-4650-82b1-fbc2c6e299ba req-3b5569c5-3d94-4ca3-8d6e-90b2ac22a195 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:25.017902 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-1824617d-1655-4650-82b1-fbc2c6e299ba req-3b5569c5-3d94-4ca3-8d6e-90b2ac22a195 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:25.018462 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-1824617d-1655-4650-82b1-fbc2c6e299ba req-3b5569c5-3d94-4ca3-8d6e-90b2ac22a195 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:25.031787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-1824617d-1655-4650-82b1-fbc2c6e299ba req-3b5569c5-3d94-4ca3-8d6e-90b2ac22a195 service nova] Creating event network-vif-deleted:1b4bf2a7-2e87-4a14-894c-d018f847fb5b for instance a712d2c4-a489-45e8-941a-13abba66403c on hv-cinder-85707 Sep 13 03:33:25.039322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-1824617d-1655-4650-82b1-fbc2c6e299ba req-3b5569c5-3d94-4ca3-8d6e-90b2ac22a195 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036319 Sep 13 03:33:25.040021 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 570/1173] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:25.265309 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:25.265917 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:25.285091 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:25.285589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:25.286029 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:25.287126 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:25.287470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:25.287923 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:25.329683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:25.330170 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:25.331046 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:25.331502 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lazy-loading 'fault' on Instance uuid a712d2c4-a489-45e8-941a-13abba66403c {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:33:25.375444 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:25.386654 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:25.388759 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:25.390454 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e9e6713f-d893-4a65-bd99-ad3c135f8d60 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1372 microversion: 2.20 time: 0.129261 Sep 13 03:33:25.394737 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 604/1174] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:33:25 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1372 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:33:25.573845 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-9e385378-7657-473d-b9b3-5ebde496c81c tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f8935a33160>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:25.605400 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-9e385378-7657-473d-b9b3-5ebde496c81c tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 200 len: 286 microversion: 2.1 time: 0.035680 Sep 13 03:33:25.606171 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 571/1175] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:25 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:26.416212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:26.416828 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:26.423771 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:26.424255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:26.424692 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:26.425383 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:26.425837 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:26.426261 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:26.457046 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:26.457524 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:26.457959 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:26.458401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lazy-loading 'fault' on Instance uuid a712d2c4-a489-45e8-941a-13abba66403c {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:33:26.497401 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:26.505759 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:26.507241 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:26.508388 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-be627e27-de74-4e6a-aef4-11ac603f6068 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1372 microversion: 2.20 time: 0.096385 Sep 13 03:33:26.508939 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 605/1176] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:33:26 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:33:26.619167 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-dd885574-3889-4349-9859-c4e0873f5c53 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f89356c2280>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:26.648901 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-dd885574-3889-4349-9859-c4e0873f5c53 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 200 len: 286 microversion: 2.1 time: 0.034076 Sep 13 03:33:26.649453 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 572/1177] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:26 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:27.533414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:27.534022 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:27.540633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:27.541118 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:27.541556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:27.542239 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:27.542723 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:27.543148 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:27.547080 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:27.575544 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:27.576029 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:27.576466 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:27.576916 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lazy-loading 'fault' on Instance uuid a712d2c4-a489-45e8-941a-13abba66403c {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:33:27.617398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:27.625658 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:27.627115 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:27.628251 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6f6b5cc4-aa4c-4ba0-8ba5-fa42576e33fb tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1372 microversion: 2.20 time: 0.098792 Sep 13 03:33:27.628812 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 606/1178] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:33:27 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:33:27.662415 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3c93f105-1663-4c75-aca1-695fe243e2db tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f8935b7d670>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:27.691148 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3c93f105-1663-4c75-aca1-695fe243e2db tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 200 len: 286 microversion: 2.1 time: 0.033745 Sep 13 03:33:27.691722 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 573/1179] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:27 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:28.653073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:28.653709 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:28.660277 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:28.660757 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:28.661189 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:28.662122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:28.662575 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:28.663021 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:28.696851 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:28.697324 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:28.697755 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:28.698192 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lazy-loading 'fault' on Instance uuid a712d2c4-a489-45e8-941a-13abba66403c {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:33:28.704890 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7725a7c8-9f8e-4ba0-ba9c-aad5c02e08b8 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f8935a7f280>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:28.734361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7725a7c8-9f8e-4ba0-ba9c-aad5c02e08b8 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 200 len: 286 microversion: 2.1 time: 0.034479 Sep 13 03:33:28.734948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 574/1180] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:28 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:33:28.742520 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:28.750586 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:28.752079 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83bd9ab163ba4229bcfd810345430564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b7c5a1fd8a24526b7859fdb030ccb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:33:28.753221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-799bb126-b158-4af0-a3c7-c072912ec304 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 200 len: 1372 microversion: 2.20 time: 0.103948 Sep 13 03:33:28.753766 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 607/1181] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:33:28 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 03:33:29.747718 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d43f6208-ef27-40a0-8864-88443eeb4875 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f89356a2280>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:29.777186 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d43f6208-ef27-40a0-8864-88443eeb4875 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 200 len: 286 microversion: 2.1 time: 0.033731 Sep 13 03:33:29.777565 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3d0ba1b9-15dc-4a74-9ad0-aa03ba554d03 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:29.777996 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 575/1182] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:29 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:29.778242 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3d0ba1b9-15dc-4a74-9ad0-aa03ba554d03 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:29.784770 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3d0ba1b9-15dc-4a74-9ad0-aa03ba554d03 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:29.785260 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3d0ba1b9-15dc-4a74-9ad0-aa03ba554d03 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:29.785696 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3d0ba1b9-15dc-4a74-9ad0-aa03ba554d03 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:29.786384 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3d0ba1b9-15dc-4a74-9ad0-aa03ba554d03 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:29.787118 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3d0ba1b9-15dc-4a74-9ad0-aa03ba554d03 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:29.787541 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3d0ba1b9-15dc-4a74-9ad0-aa03ba554d03 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:29.801008 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-3d0ba1b9-15dc-4a74-9ad0-aa03ba554d03 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] HTTP exception thrown: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3d0ba1b9-15dc-4a74-9ad0-aa03ba554d03 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Request method failure captured: Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c HTTP/1.1 Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cWOLycv9HLDQnyk31FgNef0ShqRhwvzEZRKAdMOVFz_Xpr7-T4pqZEOUUi3ruNkNxuZCxpSWFTKnvlbdgUUEqS6aW8tzLibvJLYXRrxhJz0KVv5qhZGHohvxzimtpKLMIO_X6JdECuzh_aTx9hfHBXs_x6eCqIMTWmHhSNl1U_A_k Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 9b7c5a1fd8a24526b7859fdb030ccb95 Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:33:29.802672 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:33:29.804367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b7c5a1fd8a24526b7859fdb030ccb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b7c5a1fd8a24526b7859fdb030ccb95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b7c5a1fd8a24526b7859fdb030ccb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b7c5a1fd8a24526b7859fdb030ccb95"}]}] Sep 13 03:33:29.804367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:29.804367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 9b7c5a1fd8a24526b7859fdb030ccb95 Sep 13 03:33:29.804367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:29.804367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-AttachVolumeShelveTestJSON-2106680885-project Sep 13 03:33:29.804367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:33:29.804367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:33:29.804367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 83bd9ab163ba4229bcfd810345430564 Sep 13 03:33:29.804367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2106680885-project Sep 13 03:33:29.804367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:33:29.804367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:29.804367 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'a712d2c4-a489-45e8-941a-13abba66403c'} Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:29.805270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:29.806555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:29.807968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3d0ba1b9-15dc-4a74-9ad0-aa03ba554d03 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Returning 404 to user: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:29.807968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3d0ba1b9-15dc-4a74-9ad0-aa03ba554d03 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 404 len: 111 microversion: 2.20 time: 0.030407 Sep 13 03:33:29.807968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 608/1183] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:33:29 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 03:33:29.812769 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3a8d998a-66c9-4146-8d54-f0d15750da96 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '.version_select at 0x7f89356914c0>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:29.833956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3a8d998a-66c9-4146-8d54-f0d15750da96 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778160679" status: 204 len: 0 microversion: 2.20 time: 0.025038 Sep 13 03:33:29.834514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 576/1184] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Sep 13 03:33:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778160679 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 03:33:30.789617 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-82d1a0ab-4354-4ae2-a190-13fa3dddf896 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f8936589430>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:30.819064 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-82d1a0ab-4354-4ae2-a190-13fa3dddf896 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 200 len: 287 microversion: 2.1 time: 0.033510 Sep 13 03:33:30.819681 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 609/1185] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:30 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:30.831432 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-29adfef9-fb6f-4f91-aea4-9d83ebfbdb73 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f893582be50>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:30.889621 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-29adfef9-fb6f-4f91-aea4-9d83ebfbdb73 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 202 len: 0 microversion: 2.1 time: 0.062641 Sep 13 03:33:30.890269 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 577/1186] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Sep 13 03:33:30 2022] DELETE /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:33:30.898892 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-dcd01474-5635-42cd-b9c6-abef7b9bfc9f tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f89358b7310>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:30.927638 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-dcd01474-5635-42cd-b9c6-abef7b9bfc9f tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 200 len: 286 microversion: 2.1 time: 0.032562 Sep 13 03:33:30.928185 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 610/1187] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:30 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:31.941120 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ec117f6c-1fd2-4d26-8cee-301dc5c339d1 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f8935b8e700>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:31.970180 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ec117f6c-1fd2-4d26-8cee-301dc5c339d1 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 200 len: 286 microversion: 2.1 time: 0.033826 Sep 13 03:33:31.970764 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 578/1188] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:31 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:32.983161 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a05ba908-f6ea-4b31-89c2-8578e8d0940d tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f893593ab80>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:33.012133 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a05ba908-f6ea-4b31-89c2-8578e8d0940d tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 200 len: 286 microversion: 2.1 time: 0.033941 Sep 13 03:33:33.012694 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 611/1189] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:32 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:34.025457 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7dd99186-7bb9-4adf-90cd-21e078698412 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f89356c21f0>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:34.054523 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7dd99186-7bb9-4adf-90cd-21e078698412 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 200 len: 286 microversion: 2.1 time: 0.033424 Sep 13 03:33:34.055121 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 579/1190] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:34 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:35.068122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-812c964d-612d-440d-bb74-aa2aa924bd1c tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f89358e8310>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:35.099629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-812c964d-612d-440d-bb74-aa2aa924bd1c tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 200 len: 286 microversion: 2.1 time: 0.035921 Sep 13 03:33:35.100191 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 612/1191] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:35 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:35.791146 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=21 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:35.795468 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-221a6fdd-dab1-4226-a0df-85de6cebc18e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:35.795882 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-221a6fdd-dab1-4226-a0df-85de6cebc18e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:35.802096 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:35.803537 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-221a6fdd-dab1-4226-a0df-85de6cebc18e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:35.804027 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-221a6fdd-dab1-4226-a0df-85de6cebc18e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:35.804461 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-221a6fdd-dab1-4226-a0df-85de6cebc18e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:35.805162 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-221a6fdd-dab1-4226-a0df-85de6cebc18e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:35.805638 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-221a6fdd-dab1-4226-a0df-85de6cebc18e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:35.806061 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-221a6fdd-dab1-4226-a0df-85de6cebc18e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:35.821547 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-221a6fdd-dab1-4226-a0df-85de6cebc18e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] HTTP exception thrown: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-221a6fdd-dab1-4226-a0df-85de6cebc18e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Request method failure captured: Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: DELETE /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c HTTP/1.1 Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cWOLycv9HLDQnyk31FgNef0ShqRhwvzEZRKAdMOVFz_Xpr7-T4pqZEOUUi3ruNkNxuZCxpSWFTKnvlbdgUUEqS6aW8tzLibvJLYXRrxhJz0KVv5qhZGHohvxzimtpKLMIO_X6JdECuzh_aTx9hfHBXs_x6eCqIMTWmHhSNl1U_A_k Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 9b7c5a1fd8a24526b7859fdb030ccb95 Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:33:35.823377 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:33:35.824995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b7c5a1fd8a24526b7859fdb030ccb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b7c5a1fd8a24526b7859fdb030ccb95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b7c5a1fd8a24526b7859fdb030ccb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b7c5a1fd8a24526b7859fdb030ccb95"}]}] Sep 13 03:33:35.824995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:35.824995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 9b7c5a1fd8a24526b7859fdb030ccb95 Sep 13 03:33:35.824995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:35.824995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeShelveTestJSON-2106680885-project Sep 13 03:33:35.824995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:33:35.824995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:33:35.824995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 83bd9ab163ba4229bcfd810345430564 Sep 13 03:33:35.824995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2106680885-project Sep 13 03:33:35.824995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:33:35.824995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:35.824995 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': 'a712d2c4-a489-45e8-941a-13abba66403c'} Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:35.826243 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:35.827628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:35.829679 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-221a6fdd-dab1-4226-a0df-85de6cebc18e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Returning 404 to user: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:35.829679 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-221a6fdd-dab1-4226-a0df-85de6cebc18e tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 404 len: 111 microversion: 2.20 time: 0.034953 Sep 13 03:33:35.829679 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 580/1192] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Sep 13 03:33:35 2022] DELETE /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 03:33:35.833283 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b2c1b188-a213-4723-9245-1ed44623c40c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:35.833929 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b2c1b188-a213-4723-9245-1ed44623c40c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a712d2c4-a489-45e8-941a-13abba66403c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:35.835876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:35.841118 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2c1b188-a213-4723-9245-1ed44623c40c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:35.841611 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2c1b188-a213-4723-9245-1ed44623c40c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:35.842044 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2c1b188-a213-4723-9245-1ed44623c40c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:35.842808 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2c1b188-a213-4723-9245-1ed44623c40c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:35.843263 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2c1b188-a213-4723-9245-1ed44623c40c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:35.843687 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b2c1b188-a213-4723-9245-1ed44623c40c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:35.858192 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-b2c1b188-a213-4723-9245-1ed44623c40c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] HTTP exception thrown: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b2c1b188-a213-4723-9245-1ed44623c40c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Request method failure captured: Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c HTTP/1.1 Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cWOLycv9HLDQnyk31FgNef0ShqRhwvzEZRKAdMOVFz_Xpr7-T4pqZEOUUi3ruNkNxuZCxpSWFTKnvlbdgUUEqS6aW8tzLibvJLYXRrxhJz0KVv5qhZGHohvxzimtpKLMIO_X6JdECuzh_aTx9hfHBXs_x6eCqIMTWmHhSNl1U_A_k Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 9b7c5a1fd8a24526b7859fdb030ccb95 Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:33:35.859753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:33:35.861470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b7c5a1fd8a24526b7859fdb030ccb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b7c5a1fd8a24526b7859fdb030ccb95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b7c5a1fd8a24526b7859fdb030ccb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b7c5a1fd8a24526b7859fdb030ccb95"}]}] Sep 13 03:33:35.861470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:35.861470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 9b7c5a1fd8a24526b7859fdb030ccb95 Sep 13 03:33:35.861470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:35.861470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-AttachVolumeShelveTestJSON-2106680885-project Sep 13 03:33:35.861470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:33:35.861470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:33:35.861470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 83bd9ab163ba4229bcfd810345430564 Sep 13 03:33:35.861470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2106680885-project Sep 13 03:33:35.861470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:33:35.861470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:35.861470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'a712d2c4-a489-45e8-941a-13abba66403c'} Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:35.862280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. Sep 13 03:33:35.864129 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:35.865264 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b2c1b188-a213-4723-9245-1ed44623c40c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Returning 404 to user: Instance a712d2c4-a489-45e8-941a-13abba66403c could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:35.865264 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b2c1b188-a213-4723-9245-1ed44623c40c tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c" status: 404 len: 111 microversion: 2.20 time: 0.031850 Sep 13 03:33:35.865264 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 613/1193] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:33:35 2022] GET /compute/v2.1/servers/a712d2c4-a489-45e8-941a-13abba66403c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 03:33:36.112587 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b176abd9-aa20-410d-8196-80699db567ee tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f893582be50>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:36.137552 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-b176abd9-aa20-410d-8196-80699db567ee tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] HTTP exception thrown: Snapshot aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 could not be found. Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b176abd9-aa20-410d-8196-80699db567ee tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Request method failure captured: Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 HTTP/1.1 Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_oCYMcnMOnfrCTILnswqaeGIMK8w8C6sN6vo8wPfs90kDo7WaMGiylfN2X_tb-rRC_1WFfX5wAehnNOTBppvo79nIerG_zU5YfKs7o50SbotwEt7fO7P5q2SbhcbRf6HUgUU-dNAqldtfd8VZoWGa48LBl4JTH2PsHvDyr79kTbcgE Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: a8768c348a7f46bd85164072acc772b0 Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2012644882 Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:33:36.139861 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:33:36.141498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a8768c348a7f46bd85164072acc772b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a8768c348a7f46bd85164072acc772b0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a8768c348a7f46bd85164072acc772b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a8768c348a7f46bd85164072acc772b0"}]}] Sep 13 03:33:36.141498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2012644882 Sep 13 03:33:36.141498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: a8768c348a7f46bd85164072acc772b0 Sep 13 03:33:36.141498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2012644882 Sep 13 03:33:36.141498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-VolumesSnapshotsTestJSON-2012644882-project Sep 13 03:33:36.141498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:33:36.141498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:33:36.141498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 44eef37fd6fc4dcc923b066da840594a Sep 13 03:33:36.141498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2012644882-project Sep 13 03:33:36.141498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: Sep 13 03:33:36.141498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Snapshot aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 could not be found. Sep 13 03:33:36.141498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': 'aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4'} Sep 13 03:33:36.141498 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 could not be found. (HTTP 404) (Request-ID: req-8453c415-457a-4e7f-ae36-3950c7b21a9b) Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:36.142655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 03:33:36.144101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 could not be found. Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 03:33:36.145556 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:36.147113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 could not be found. Sep 13 03:33:36.147113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:36.147113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:36.147113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:36.147113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:36.147113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:36.147113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:36.147113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:36.147113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:36.147113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 could not be found. Sep 13 03:33:36.147113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:36.147113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b176abd9-aa20-410d-8196-80699db567ee tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Returning 404 to user: Snapshot aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:36.147113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b176abd9-aa20-410d-8196-80699db567ee tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4" status: 404 len: 111 microversion: 2.1 time: 0.032651 Sep 13 03:33:36.148120 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 581/1194] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 03:33:36 2022] GET /compute/v2.1/os-snapshots/aeed529f-cffa-4bb5-bc6d-9f1a14ed80a4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:33:36.150150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-26c3efd4-c90d-4457-acc6-4c10dcd8d125 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f893594d040>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:36.210197 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-26c3efd4-c90d-4457-acc6-4c10dcd8d125 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a" status: 202 len: 0 microversion: 2.1 time: 0.064023 Sep 13 03:33:36.210832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 614/1195] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 03:33:36 2022] DELETE /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 03:33:36.218954 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6898916e-a7b8-4dc0-a279-ba19938ae773 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f8935732f70>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:36.266930 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6898916e-a7b8-4dc0-a279-ba19938ae773 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a" status: 200 len: 345 microversion: 2.1 time: 0.051628 Sep 13 03:33:36.267501 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 582/1196] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:33:36 2022] GET /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:33:37.016026 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-deb9d302-6c38-422c-a3c6-bd8e736914e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:37.016825 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-deb9d302-6c38-422c-a3c6-bd8e736914e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:37.026421 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-deb9d302-6c38-422c-a3c6-bd8e736914e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:37.026953 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-deb9d302-6c38-422c-a3c6-bd8e736914e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:37.027396 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-deb9d302-6c38-422c-a3c6-bd8e736914e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:37.028100 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-deb9d302-6c38-422c-a3c6-bd8e736914e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:37.028913 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-deb9d302-6c38-422c-a3c6-bd8e736914e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:37.029062 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-deb9d302-6c38-422c-a3c6-bd8e736914e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:37.042502 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-deb9d302-6c38-422c-a3c6-bd8e736914e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] HTTP exception thrown: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-deb9d302-6c38-422c-a3c6-bd8e736914e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Request method failure captured: Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: DELETE /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee HTTP/1.1 Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_cWOLycv9HLDQnyk31FgNef0ShqRhwvzEZRKAdMOVFz_Xpr7-T4pqZEOUUi3ruNkNxuZCxpSWFTKnvlbdgUUEqS6aW8tzLibvJLYXRrxhJz0KVv5qhZGHohvxzimtpKLMIO_X6JdECuzh_aTx9hfHBXs_x6eCqIMTWmHhSNl1U_A_k Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 9b7c5a1fd8a24526b7859fdb030ccb95 Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:33:37.044083 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:33:37.045542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b7c5a1fd8a24526b7859fdb030ccb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b7c5a1fd8a24526b7859fdb030ccb95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b7c5a1fd8a24526b7859fdb030ccb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b7c5a1fd8a24526b7859fdb030ccb95"}]}] Sep 13 03:33:37.045542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:37.045542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 9b7c5a1fd8a24526b7859fdb030ccb95 Sep 13 03:33:37.045542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:37.045542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-AttachVolumeShelveTestJSON-2106680885-project Sep 13 03:33:37.045542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:33:37.045542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:33:37.045542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 83bd9ab163ba4229bcfd810345430564 Sep 13 03:33:37.045542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2106680885-project Sep 13 03:33:37.045542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:33:37.045542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:33:37.045542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'a97f011a-6370-474e-9a62-e9229eb7d7ee'} Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:37.046377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:33:37.047906 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.049398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-deb9d302-6c38-422c-a3c6-bd8e736914e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Returning 404 to user: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:37.049398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-deb9d302-6c38-422c-a3c6-bd8e736914e2 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 404 len: 111 microversion: 2.20 time: 0.034003 Sep 13 03:33:37.049398 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 615/1197] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Sep 13 03:33:37 2022] DELETE /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 03:33:37.055552 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a37b035b-6fca-4201-b988-cfcf1603a552 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:37.056048 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a37b035b-6fca-4201-b988-cfcf1603a552 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] [instance: a97f011a-6370-474e-9a62-e9229eb7d7ee] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:33:37.061943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a37b035b-6fca-4201-b988-cfcf1603a552 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:37.062440 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a37b035b-6fca-4201-b988-cfcf1603a552 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:37.062927 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a37b035b-6fca-4201-b988-cfcf1603a552 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:37.063634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a37b035b-6fca-4201-b988-cfcf1603a552 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:33:37.064105 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a37b035b-6fca-4201-b988-cfcf1603a552 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:33:37.064534 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a37b035b-6fca-4201-b988-cfcf1603a552 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:33:37.078850 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-a37b035b-6fca-4201-b988-cfcf1603a552 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] HTTP exception thrown: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a37b035b-6fca-4201-b988-cfcf1603a552 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Request method failure captured: Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee HTTP/1.1 Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_cWOLycv9HLDQnyk31FgNef0ShqRhwvzEZRKAdMOVFz_Xpr7-T4pqZEOUUi3ruNkNxuZCxpSWFTKnvlbdgUUEqS6aW8tzLibvJLYXRrxhJz0KVv5qhZGHohvxzimtpKLMIO_X6JdECuzh_aTx9hfHBXs_x6eCqIMTWmHhSNl1U_A_k Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 9b7c5a1fd8a24526b7859fdb030ccb95 Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:33:37.080459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:33:37.082948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b7c5a1fd8a24526b7859fdb030ccb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b7c5a1fd8a24526b7859fdb030ccb95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b7c5a1fd8a24526b7859fdb030ccb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b7c5a1fd8a24526b7859fdb030ccb95"}]}] Sep 13 03:33:37.082948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:37.082948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 9b7c5a1fd8a24526b7859fdb030ccb95 Sep 13 03:33:37.082948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2106680885 Sep 13 03:33:37.082948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-AttachVolumeShelveTestJSON-2106680885-project Sep 13 03:33:37.082948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:33:37.082948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:33:37.082948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 83bd9ab163ba4229bcfd810345430564 Sep 13 03:33:37.082948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2106680885-project Sep 13 03:33:37.082948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:33:37.082948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:33:37.082948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': 'a97f011a-6370-474e-9a62-e9229eb7d7ee'} Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:37.083838 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. Sep 13 03:33:37.085357 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.086734 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a37b035b-6fca-4201-b988-cfcf1603a552 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] Returning 404 to user: Instance a97f011a-6370-474e-9a62-e9229eb7d7ee could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:37.086734 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a37b035b-6fca-4201-b988-cfcf1603a552 tempest-AttachVolumeShelveTestJSON-2106680885 tempest-AttachVolumeShelveTestJSON-2106680885-project] 10.222.0.18 "GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee" status: 404 len: 111 microversion: 2.20 time: 0.031637 Sep 13 03:33:37.086734 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 583/1198] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 03:33:37 2022] GET /compute/v2.1/servers/a97f011a-6370-474e-9a62-e9229eb7d7ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 03:33:37.281331 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d9f5283c-3ad7-4856-9fb8-ca6805271738 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f89358e8790>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:37.309923 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-d9f5283c-3ad7-4856-9fb8-ca6805271738 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] HTTP exception thrown: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d9f5283c-3ad7-4856-9fb8-ca6805271738 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Request method failure captured: Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a HTTP/1.1 Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_oCYMcnMOnfrCTILnswqaeGIMK8w8C6sN6vo8wPfs90kDo7WaMGiylfN2X_tb-rRC_1WFfX5wAehnNOTBppvo79nIerG_zU5YfKs7o50SbotwEt7fO7P5q2SbhcbRf6HUgUU-dNAqldtfd8VZoWGa48LBl4JTH2PsHvDyr79kTbcgE Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: a8768c348a7f46bd85164072acc772b0 Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2012644882 Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:33:37.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:33:37.313589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a8768c348a7f46bd85164072acc772b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a8768c348a7f46bd85164072acc772b0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a8768c348a7f46bd85164072acc772b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a8768c348a7f46bd85164072acc772b0"}]}] Sep 13 03:33:37.313589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2012644882 Sep 13 03:33:37.313589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: a8768c348a7f46bd85164072acc772b0 Sep 13 03:33:37.313589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2012644882 Sep 13 03:33:37.313589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-VolumesSnapshotsTestJSON-2012644882-project Sep 13 03:33:37.313589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:33:37.313589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:33:37.313589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 44eef37fd6fc4dcc923b066da840594a Sep 13 03:33:37.313589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2012644882-project Sep 13 03:33:37.313589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: Sep 13 03:33:37.313589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.313589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': '718b0caf-a0aa-4d73-86ba-5074da131c3a'} Sep 13 03:33:37.313589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. (HTTP 404) (Request-ID: req-06801679-eff1-4859-98a5-ec4ba19a7b37) Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:37.314568 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 03:33:37.316651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 03:33:37.319208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d9f5283c-3ad7-4856-9fb8-ca6805271738 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Returning 404 to user: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d9f5283c-3ad7-4856-9fb8-ca6805271738 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a" status: 404 len: 109 microversion: 2.1 time: 0.036026 Sep 13 03:33:37.320674 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 616/1199] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:33:37 2022] GET /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:33:37.331965 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3d8aa926-5203-4ce6-be75-80f10441b685 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f8935900c10>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:37.359301 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-3d8aa926-5203-4ce6-be75-80f10441b685 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] HTTP exception thrown: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3d8aa926-5203-4ce6-be75-80f10441b685 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Request method failure captured: Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: DELETE /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a HTTP/1.1 Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_oCYMcnMOnfrCTILnswqaeGIMK8w8C6sN6vo8wPfs90kDo7WaMGiylfN2X_tb-rRC_1WFfX5wAehnNOTBppvo79nIerG_zU5YfKs7o50SbotwEt7fO7P5q2SbhcbRf6HUgUU-dNAqldtfd8VZoWGa48LBl4JTH2PsHvDyr79kTbcgE Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: a8768c348a7f46bd85164072acc772b0 Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2012644882 Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:33:37.361330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:33:37.363483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a8768c348a7f46bd85164072acc772b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a8768c348a7f46bd85164072acc772b0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a8768c348a7f46bd85164072acc772b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a8768c348a7f46bd85164072acc772b0"}]}] Sep 13 03:33:37.363483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2012644882 Sep 13 03:33:37.363483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: a8768c348a7f46bd85164072acc772b0 Sep 13 03:33:37.363483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2012644882 Sep 13 03:33:37.363483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-VolumesSnapshotsTestJSON-2012644882-project Sep 13 03:33:37.363483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:33:37.363483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:33:37.363483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 44eef37fd6fc4dcc923b066da840594a Sep 13 03:33:37.363483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2012644882-project Sep 13 03:33:37.363483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: Sep 13 03:33:37.363483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.363483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': '718b0caf-a0aa-4d73-86ba-5074da131c3a'} Sep 13 03:33:37.363483 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. (HTTP 404) (Request-ID: req-4d726dcd-a230-4849-8e51-76ba645904a0) Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:37.364450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 03:33:37.365945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 03:33:37.367404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:37.368808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.368808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.368808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:37.368808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.368808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.368808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:37.368808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:37.368808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:37.368808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:37.368808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.368808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.368808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3d8aa926-5203-4ce6-be75-80f10441b685 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Returning 404 to user: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:37.368808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3d8aa926-5203-4ce6-be75-80f10441b685 tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a" status: 404 len: 109 microversion: 2.1 time: 0.034851 Sep 13 03:33:37.369787 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 584/1200] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 03:33:37 2022] DELETE /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:33:37.371905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-bba55fa8-79ac-421c-b5f7-50b832ce492e tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Calling method '.version_select at 0x7f8935945e50>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:33:37.401134 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-bba55fa8-79ac-421c-b5f7-50b832ce492e tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] HTTP exception thrown: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-bba55fa8-79ac-421c-b5f7-50b832ce492e tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Request method failure captured: Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a HTTP/1.1 Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_oCYMcnMOnfrCTILnswqaeGIMK8w8C6sN6vo8wPfs90kDo7WaMGiylfN2X_tb-rRC_1WFfX5wAehnNOTBppvo79nIerG_zU5YfKs7o50SbotwEt7fO7P5q2SbhcbRf6HUgUU-dNAqldtfd8VZoWGa48LBl4JTH2PsHvDyr79kTbcgE Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: a8768c348a7f46bd85164072acc772b0 Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2012644882 Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:33:37.403339 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:33:37.404876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a8768c348a7f46bd85164072acc772b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a8768c348a7f46bd85164072acc772b0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a8768c348a7f46bd85164072acc772b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a8768c348a7f46bd85164072acc772b0"}]}] Sep 13 03:33:37.404876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2012644882 Sep 13 03:33:37.404876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: a8768c348a7f46bd85164072acc772b0 Sep 13 03:33:37.404876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2012644882 Sep 13 03:33:37.404876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-VolumesSnapshotsTestJSON-2012644882-project Sep 13 03:33:37.404876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:33:37.404876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:33:37.404876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 44eef37fd6fc4dcc923b066da840594a Sep 13 03:33:37.404876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2012644882-project Sep 13 03:33:37.404876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: Sep 13 03:33:37.404876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.404876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': '718b0caf-a0aa-4d73-86ba-5074da131c3a'} Sep 13 03:33:37.404876 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. (HTTP 404) (Request-ID: req-d209db49-b979-47b5-9c1a-61b926246b37) Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:37.405845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 03:33:37.407052 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 03:33:37.408236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-bba55fa8-79ac-421c-b5f7-50b832ce492e tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] Returning 404 to user: Volume 718b0caf-a0aa-4d73-86ba-5074da131c3a could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-bba55fa8-79ac-421c-b5f7-50b832ce492e tempest-VolumesSnapshotsTestJSON-2012644882 tempest-VolumesSnapshotsTestJSON-2012644882-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a" status: 404 len: 109 microversion: 2.1 time: 0.036905 Sep 13 03:33:37.409425 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 617/1201] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 03:33:37 2022] GET /compute/v2.1/os-volumes/718b0caf-a0aa-4d73-86ba-5074da131c3a => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:34:58.879696 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=3 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:34:58.880743 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=4 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:34:58.884275 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 13 03:34:58.891392 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1ac3e928-dd9a-4b8c-b17c-c49c65121219 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1827163671"}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:34:58.892055 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-1ac3e928-dd9a-4b8c-b17c-c49c65121219 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:34:58.899168 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ac3e928-dd9a-4b8c-b17c-c49c65121219 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:34:58.899714 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ac3e928-dd9a-4b8c-b17c-c49c65121219 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:34:58.900160 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ac3e928-dd9a-4b8c-b17c-c49c65121219 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:34:58.900908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ac3e928-dd9a-4b8c-b17c-c49c65121219 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:34:58.901420 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ac3e928-dd9a-4b8c-b17c-c49c65121219 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:34:58.901896 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ac3e928-dd9a-4b8c-b17c-c49c65121219 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:34:59.066804 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.network.security_group_api [None req-1ac3e928-dd9a-4b8c-b17c-c49c65121219 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Removing security group f61ba66a-6468-4582-b17f-fe248aede443 from port fd8213ce-3653-4272-bd22-22e80d1944df Sep 13 03:34:59.413226 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1ac3e928-dd9a-4b8c-b17c-c49c65121219 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "POST /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/action" status: 202 len: 0 microversion: 2.1 time: 0.534625 Sep 13 03:34:59.418994 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=3 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:34:59.419612 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 585/1202] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 03:34:58 2022] POST /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:34:59.420621 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=20 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:34:59.421926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 03:34:59.425420 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Tue Sep 13 03:34:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Sep 13 03:34:59.712776 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-2985319a-b90e-44e7-a3f7-8d4411c5b600 req-3e7ee8c2-42ea-4007-8fe1-4a2f359fed09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c5c35a-9c3f-4796-a202-214bcff70431", "tag": "fd8213ce-3653-4272-bd22-22e80d1944df"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:34:59.731096 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2985319a-b90e-44e7-a3f7-8d4411c5b600 req-3e7ee8c2-42ea-4007-8fe1-4a2f359fed09 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:34:59.735708 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2985319a-b90e-44e7-a3f7-8d4411c5b600 req-3e7ee8c2-42ea-4007-8fe1-4a2f359fed09 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:34:59.736703 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2985319a-b90e-44e7-a3f7-8d4411c5b600 req-3e7ee8c2-42ea-4007-8fe1-4a2f359fed09 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:34:59.755007 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-2985319a-b90e-44e7-a3f7-8d4411c5b600 req-3e7ee8c2-42ea-4007-8fe1-4a2f359fed09 service nova] Creating event network-changed:fd8213ce-3653-4272-bd22-22e80d1944df for instance d4c5c35a-9c3f-4796-a202-214bcff70431 on hv-cinder-85707 Sep 13 03:34:59.764801 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-2985319a-b90e-44e7-a3f7-8d4411c5b600 req-3e7ee8c2-42ea-4007-8fe1-4a2f359fed09 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.349194 Sep 13 03:34:59.767329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 618/1203] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:01.141025 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7055be0e-2456-41bf-a8e6-1789d5f2a68e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:01.142265 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7055be0e-2456-41bf-a8e6-1789d5f2a68e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:01.149612 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-c927dc32-c8fa-493b-acbc-9a4f7e369908 req-481c8f3a-ddcf-4a65-a9cc-9ef29e97ded7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c5c35a-9c3f-4796-a202-214bcff70431", "tag": "fd8213ce-3653-4272-bd22-22e80d1944df"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:35:01.153795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7055be0e-2456-41bf-a8e6-1789d5f2a68e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:01.154365 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7055be0e-2456-41bf-a8e6-1789d5f2a68e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:01.154956 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7055be0e-2456-41bf-a8e6-1789d5f2a68e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:01.155795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7055be0e-2456-41bf-a8e6-1789d5f2a68e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:01.156308 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7055be0e-2456-41bf-a8e6-1789d5f2a68e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:01.156945 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7055be0e-2456-41bf-a8e6-1789d5f2a68e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:01.170880 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-c927dc32-c8fa-493b-acbc-9a4f7e369908 req-481c8f3a-ddcf-4a65-a9cc-9ef29e97ded7 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:01.171376 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-c927dc32-c8fa-493b-acbc-9a4f7e369908 req-481c8f3a-ddcf-4a65-a9cc-9ef29e97ded7 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:01.171812 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-c927dc32-c8fa-493b-acbc-9a4f7e369908 req-481c8f3a-ddcf-4a65-a9cc-9ef29e97ded7 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:01.200520 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-c927dc32-c8fa-493b-acbc-9a4f7e369908 req-481c8f3a-ddcf-4a65-a9cc-9ef29e97ded7 service nova] Creating event network-changed:fd8213ce-3653-4272-bd22-22e80d1944df for instance d4c5c35a-9c3f-4796-a202-214bcff70431 on hv-cinder-85707 Sep 13 03:35:01.213848 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-c927dc32-c8fa-493b-acbc-9a4f7e369908 req-481c8f3a-ddcf-4a65-a9cc-9ef29e97ded7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073995 Sep 13 03:35:01.214450 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 619/1204] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:01.252339 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-7055be0e-2456-41bf-a8e6-1789d5f2a68e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lazy-loading 'services' on Instance uuid d4c5c35a-9c3f-4796-a202-214bcff70431 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:35:01.334545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7055be0e-2456-41bf-a8e6-1789d5f2a68e tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments/d8b51756-11bd-414e-9df0-3d6add058886" status: 202 len: 0 microversion: 2.1 time: 0.197362 Sep 13 03:35:01.336015 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 586/1205] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 03:35:01 2022] DELETE /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments/d8b51756-11bd-414e-9df0-3d6add058886 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:35:01.350347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-fcd9217c-4843-4597-ac26-b5f29461225f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:01.354137 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-fcd9217c-4843-4597-ac26-b5f29461225f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:01.363283 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fcd9217c-4843-4597-ac26-b5f29461225f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:01.364176 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fcd9217c-4843-4597-ac26-b5f29461225f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:01.364998 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fcd9217c-4843-4597-ac26-b5f29461225f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:01.366269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fcd9217c-4843-4597-ac26-b5f29461225f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:01.366963 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fcd9217c-4843-4597-ac26-b5f29461225f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:01.367598 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fcd9217c-4843-4597-ac26-b5f29461225f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:01.415397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-fcd9217c-4843-4597-ac26-b5f29461225f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071085 Sep 13 03:35:01.421726 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 620/1206] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:01 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:02.433516 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c94a6bdb-8518-49fc-9c4e-b3895520cbc2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:02.433516 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c94a6bdb-8518-49fc-9c4e-b3895520cbc2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:02.440340 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c94a6bdb-8518-49fc-9c4e-b3895520cbc2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:02.441117 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c94a6bdb-8518-49fc-9c4e-b3895520cbc2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:02.441657 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c94a6bdb-8518-49fc-9c4e-b3895520cbc2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:02.443584 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c94a6bdb-8518-49fc-9c4e-b3895520cbc2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:02.444409 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c94a6bdb-8518-49fc-9c4e-b3895520cbc2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:02.444842 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c94a6bdb-8518-49fc-9c4e-b3895520cbc2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:02.477514 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c94a6bdb-8518-49fc-9c4e-b3895520cbc2 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052559 Sep 13 03:35:02.478186 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 587/1207] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:02 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:03.489989 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e51f5635-3bde-4e7b-90f4-898dd82eae10 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:03.492185 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e51f5635-3bde-4e7b-90f4-898dd82eae10 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:03.498477 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e51f5635-3bde-4e7b-90f4-898dd82eae10 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:03.498999 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e51f5635-3bde-4e7b-90f4-898dd82eae10 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:03.499437 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e51f5635-3bde-4e7b-90f4-898dd82eae10 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:03.500118 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e51f5635-3bde-4e7b-90f4-898dd82eae10 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:03.500573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e51f5635-3bde-4e7b-90f4-898dd82eae10 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:03.500994 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e51f5635-3bde-4e7b-90f4-898dd82eae10 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:03.529409 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e51f5635-3bde-4e7b-90f4-898dd82eae10 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043820 Sep 13 03:35:03.529967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 621/1208] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:03 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:04.541869 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-52d93a64-fa8d-4122-8ad1-08f371fb1941 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:04.544056 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-52d93a64-fa8d-4122-8ad1-08f371fb1941 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:04.550461 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-52d93a64-fa8d-4122-8ad1-08f371fb1941 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:04.550971 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-52d93a64-fa8d-4122-8ad1-08f371fb1941 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:04.551407 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-52d93a64-fa8d-4122-8ad1-08f371fb1941 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:04.552083 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-52d93a64-fa8d-4122-8ad1-08f371fb1941 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:04.552530 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-52d93a64-fa8d-4122-8ad1-08f371fb1941 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:04.552943 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-52d93a64-fa8d-4122-8ad1-08f371fb1941 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:04.581414 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-52d93a64-fa8d-4122-8ad1-08f371fb1941 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043410 Sep 13 03:35:04.581953 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 588/1209] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:04 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:05.594187 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d6c38445-487b-4cff-9ca4-3f32c3db22e6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:05.596352 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d6c38445-487b-4cff-9ca4-3f32c3db22e6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:05.603232 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d6c38445-487b-4cff-9ca4-3f32c3db22e6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:05.603719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d6c38445-487b-4cff-9ca4-3f32c3db22e6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:05.604155 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d6c38445-487b-4cff-9ca4-3f32c3db22e6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:05.604839 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d6c38445-487b-4cff-9ca4-3f32c3db22e6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:05.605296 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d6c38445-487b-4cff-9ca4-3f32c3db22e6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:05.605717 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d6c38445-487b-4cff-9ca4-3f32c3db22e6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:05.633314 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d6c38445-487b-4cff-9ca4-3f32c3db22e6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042953 Sep 13 03:35:05.633784 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 622/1210] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:05 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:06.645287 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-89486a8f-49a2-49f9-9b23-6ccfad4586cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:06.647542 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-89486a8f-49a2-49f9-9b23-6ccfad4586cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:06.653789 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-89486a8f-49a2-49f9-9b23-6ccfad4586cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:06.654266 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-89486a8f-49a2-49f9-9b23-6ccfad4586cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:06.654730 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-89486a8f-49a2-49f9-9b23-6ccfad4586cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:06.655409 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-89486a8f-49a2-49f9-9b23-6ccfad4586cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:06.655888 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-89486a8f-49a2-49f9-9b23-6ccfad4586cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:06.656307 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-89486a8f-49a2-49f9-9b23-6ccfad4586cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:06.685310 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-89486a8f-49a2-49f9-9b23-6ccfad4586cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Sep 13 03:35:06.685853 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 589/1211] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:06 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:07.697981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c52ebdfb-7d5f-41e0-b939-44883862e2ac tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:07.700278 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c52ebdfb-7d5f-41e0-b939-44883862e2ac tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:07.706670 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c52ebdfb-7d5f-41e0-b939-44883862e2ac tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:07.707185 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c52ebdfb-7d5f-41e0-b939-44883862e2ac tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:07.707625 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c52ebdfb-7d5f-41e0-b939-44883862e2ac tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:07.708309 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c52ebdfb-7d5f-41e0-b939-44883862e2ac tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:07.708789 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c52ebdfb-7d5f-41e0-b939-44883862e2ac tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:07.709213 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c52ebdfb-7d5f-41e0-b939-44883862e2ac tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:07.738278 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c52ebdfb-7d5f-41e0-b939-44883862e2ac tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Sep 13 03:35:07.739420 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 623/1212] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:07 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:08.751178 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e2c5ba7d-b87a-45ec-bd80-53785bf21045 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:08.753322 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-e2c5ba7d-b87a-45ec-bd80-53785bf21045 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:08.760183 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e2c5ba7d-b87a-45ec-bd80-53785bf21045 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:08.760662 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e2c5ba7d-b87a-45ec-bd80-53785bf21045 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:08.761097 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e2c5ba7d-b87a-45ec-bd80-53785bf21045 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:08.761775 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e2c5ba7d-b87a-45ec-bd80-53785bf21045 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:08.762226 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e2c5ba7d-b87a-45ec-bd80-53785bf21045 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:08.762669 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-e2c5ba7d-b87a-45ec-bd80-53785bf21045 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:08.790391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e2c5ba7d-b87a-45ec-bd80-53785bf21045 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043227 Sep 13 03:35:08.790964 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 590/1213] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:08 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:09.967158 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-96aaff55-9b00-4d93-b64d-d73b84a5c38c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:09.969266 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-96aaff55-9b00-4d93-b64d-d73b84a5c38c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:09.975037 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-96aaff55-9b00-4d93-b64d-d73b84a5c38c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:09.975519 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-96aaff55-9b00-4d93-b64d-d73b84a5c38c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:09.975951 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-96aaff55-9b00-4d93-b64d-d73b84a5c38c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:09.976626 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-96aaff55-9b00-4d93-b64d-d73b84a5c38c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:09.977076 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-96aaff55-9b00-4d93-b64d-d73b84a5c38c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:09.977496 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-96aaff55-9b00-4d93-b64d-d73b84a5c38c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:10.006224 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-96aaff55-9b00-4d93-b64d-d73b84a5c38c tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207597 Sep 13 03:35:10.006811 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 624/1214] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:09 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:11.017708 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-13341ff3-ce6f-488d-b327-d99aa20046fc tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:11.019893 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-13341ff3-ce6f-488d-b327-d99aa20046fc tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:11.026847 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-13341ff3-ce6f-488d-b327-d99aa20046fc tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:11.027329 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-13341ff3-ce6f-488d-b327-d99aa20046fc tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:11.027763 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-13341ff3-ce6f-488d-b327-d99aa20046fc tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:11.028448 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-13341ff3-ce6f-488d-b327-d99aa20046fc tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:11.028901 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-13341ff3-ce6f-488d-b327-d99aa20046fc tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:11.029320 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-13341ff3-ce6f-488d-b327-d99aa20046fc tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:11.058655 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-13341ff3-ce6f-488d-b327-d99aa20046fc tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044957 Sep 13 03:35:11.059207 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 591/1215] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:11 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:12.070653 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a6f05f5f-23d4-45c2-959d-95f2ca985db1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:12.072695 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a6f05f5f-23d4-45c2-959d-95f2ca985db1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:12.079212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6f05f5f-23d4-45c2-959d-95f2ca985db1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:12.079725 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6f05f5f-23d4-45c2-959d-95f2ca985db1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:12.080305 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6f05f5f-23d4-45c2-959d-95f2ca985db1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:12.080899 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6f05f5f-23d4-45c2-959d-95f2ca985db1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:12.081344 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6f05f5f-23d4-45c2-959d-95f2ca985db1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:12.081759 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a6f05f5f-23d4-45c2-959d-95f2ca985db1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:12.110308 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a6f05f5f-23d4-45c2-959d-95f2ca985db1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043665 Sep 13 03:35:12.110909 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 625/1216] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:12 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:13.123494 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2940b6a7-d165-4b67-b03b-c8ce78c9355f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:13.125652 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2940b6a7-d165-4b67-b03b-c8ce78c9355f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:13.132791 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2940b6a7-d165-4b67-b03b-c8ce78c9355f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:13.133277 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2940b6a7-d165-4b67-b03b-c8ce78c9355f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:13.133717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2940b6a7-d165-4b67-b03b-c8ce78c9355f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:13.134408 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2940b6a7-d165-4b67-b03b-c8ce78c9355f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:13.134947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2940b6a7-d165-4b67-b03b-c8ce78c9355f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:13.135373 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2940b6a7-d165-4b67-b03b-c8ce78c9355f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:13.164257 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2940b6a7-d165-4b67-b03b-c8ce78c9355f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Sep 13 03:35:13.164814 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 592/1217] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:13 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:14.176413 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-bab9f273-14e7-493f-8f9d-afaa39ceac69 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:14.179156 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-bab9f273-14e7-493f-8f9d-afaa39ceac69 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:14.185345 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bab9f273-14e7-493f-8f9d-afaa39ceac69 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:14.185831 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bab9f273-14e7-493f-8f9d-afaa39ceac69 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:14.186264 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bab9f273-14e7-493f-8f9d-afaa39ceac69 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:14.186967 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bab9f273-14e7-493f-8f9d-afaa39ceac69 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:14.187422 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bab9f273-14e7-493f-8f9d-afaa39ceac69 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:14.187839 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-bab9f273-14e7-493f-8f9d-afaa39ceac69 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:14.215521 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-bab9f273-14e7-493f-8f9d-afaa39ceac69 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043117 Sep 13 03:35:14.216247 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 626/1218] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:14 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:15.227990 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-d0501341-ee0e-44ca-a7a0-13dc852eb827 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:15.230159 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-d0501341-ee0e-44ca-a7a0-13dc852eb827 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:15.236525 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d0501341-ee0e-44ca-a7a0-13dc852eb827 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:15.236944 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d0501341-ee0e-44ca-a7a0-13dc852eb827 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:15.237371 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d0501341-ee0e-44ca-a7a0-13dc852eb827 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:15.238051 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d0501341-ee0e-44ca-a7a0-13dc852eb827 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:15.238497 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d0501341-ee0e-44ca-a7a0-13dc852eb827 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:15.238974 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-d0501341-ee0e-44ca-a7a0-13dc852eb827 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:15.268154 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-d0501341-ee0e-44ca-a7a0-13dc852eb827 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044155 Sep 13 03:35:15.268705 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 593/1219] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:15 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:16.281232 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-7f15ef6e-fd37-45bd-95d7-bed2231c4384 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:16.283405 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-7f15ef6e-fd37-45bd-95d7-bed2231c4384 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:16.290385 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7f15ef6e-fd37-45bd-95d7-bed2231c4384 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:16.290834 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7f15ef6e-fd37-45bd-95d7-bed2231c4384 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:16.291269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7f15ef6e-fd37-45bd-95d7-bed2231c4384 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:16.291953 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7f15ef6e-fd37-45bd-95d7-bed2231c4384 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:16.292589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7f15ef6e-fd37-45bd-95d7-bed2231c4384 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:16.293012 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-7f15ef6e-fd37-45bd-95d7-bed2231c4384 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:16.324158 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-7f15ef6e-fd37-45bd-95d7-bed2231c4384 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046764 Sep 13 03:35:16.324709 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 627/1220] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:16 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:17.337020 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-30ec5247-602a-48eb-93b5-ba46c29e84f8 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:17.339100 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-30ec5247-602a-48eb-93b5-ba46c29e84f8 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:17.345659 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-30ec5247-602a-48eb-93b5-ba46c29e84f8 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:17.346146 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-30ec5247-602a-48eb-93b5-ba46c29e84f8 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:17.346577 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-30ec5247-602a-48eb-93b5-ba46c29e84f8 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:17.347299 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-30ec5247-602a-48eb-93b5-ba46c29e84f8 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:17.347749 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-30ec5247-602a-48eb-93b5-ba46c29e84f8 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:17.348167 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-30ec5247-602a-48eb-93b5-ba46c29e84f8 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:17.376966 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-30ec5247-602a-48eb-93b5-ba46c29e84f8 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044477 Sep 13 03:35:17.377527 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 594/1221] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 03:35:17 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 03:35:17.390143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8e1f6116-f531-4bd5-a201-926455e7b288 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:17.390731 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8e1f6116-f531-4bd5-a201-926455e7b288 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:17.397611 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8e1f6116-f531-4bd5-a201-926455e7b288 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:17.398098 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8e1f6116-f531-4bd5-a201-926455e7b288 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:17.398535 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8e1f6116-f531-4bd5-a201-926455e7b288 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:17.399383 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8e1f6116-f531-4bd5-a201-926455e7b288 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:17.399843 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8e1f6116-f531-4bd5-a201-926455e7b288 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:17.400271 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8e1f6116-f531-4bd5-a201-926455e7b288 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:17.475468 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-8e1f6116-f531-4bd5-a201-926455e7b288 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] HTTP exception thrown: Instance d4c5c35a-9c3f-4796-a202-214bcff70431 is not attached to volume d8b51756-11bd-414e-9df0-3d6add058886 Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8e1f6116-f531-4bd5-a201-926455e7b288 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Request method failure captured: Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: DELETE /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments/d8b51756-11bd-414e-9df0-3d6add058886 HTTP/1.1 Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_k9bSgeqk-czjg1Xpx1JwXJA8AEUOadR8hmIJ81cp-kb4aK9-WU4_VB3akG01ysCdlJB0f_hfZq1VCY8Da1d7YWFixYqt6JVGBUDSlJjy6wxp9nEfVNUI-pUAK1H665YGtf2sbYzMlq2IhqFx1pE99ZfE-R4lNqbwfd2kWqBIqMAGM Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 35d0f9365a60474590ea1bb78b1654b2 Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-TestMinimumBasicScenario-88233642 Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:35:17.477942 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:35:17.479701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/35d0f9365a60474590ea1bb78b1654b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_35d0f9365a60474590ea1bb78b1654b2", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35d0f9365a60474590ea1bb78b1654b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35d0f9365a60474590ea1bb78b1654b2"}]}] Sep 13 03:35:17.479701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-TestMinimumBasicScenario-88233642 Sep 13 03:35:17.479701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 35d0f9365a60474590ea1bb78b1654b2 Sep 13 03:35:17.479701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-TestMinimumBasicScenario-88233642 Sep 13 03:35:17.479701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-TestMinimumBasicScenario-88233642-project Sep 13 03:35:17.479701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:35:17.479701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:35:17.479701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 92bba932a70f4a75b1bb1810d8826447 Sep 13 03:35:17.479701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-TestMinimumBasicScenario-88233642-project Sep 13 03:35:17.479701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:35:17.479701 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance d4c5c35a-9c3f-4796-a202-214bcff70431 is not attached to volume d8b51756-11bd-414e-9df0-3d6add058886 Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'server_id': 'd4c5c35a-9c3f-4796-a202-214bcff70431', 'id': 'd8b51756-11bd-414e-9df0-3d6add058886'} Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d8b51756-11bd-414e-9df0-3d6add058886. Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:35:17.480875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c5c35a-9c3f-4796-a202-214bcff70431 is not attached to volume d8b51756-11bd-414e-9df0-3d6add058886 Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c5c35a-9c3f-4796-a202-214bcff70431 is not attached to volume d8b51756-11bd-414e-9df0-3d6add058886 Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:35:17.482556 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8e1f6116-f531-4bd5-a201-926455e7b288 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Returning 404 to user: Instance d4c5c35a-9c3f-4796-a202-214bcff70431 is not attached to volume d8b51756-11bd-414e-9df0-3d6add058886 {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:35:17.483837 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8e1f6116-f531-4bd5-a201-926455e7b288 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments/d8b51756-11bd-414e-9df0-3d6add058886" status: 404 len: 154 microversion: 2.1 time: 0.094631 Sep 13 03:35:17.483837 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 628/1222] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 03:35:17 2022] DELETE /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431/os-volume_attachments/d8b51756-11bd-414e-9df0-3d6add058886 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:35:22.895129 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-577396075", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "networks": [{"uuid": "7d240cfb-7e7d-4f20-90ad-58260429d0d8"}]}} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:35:22.948502 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.network.neutron [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] validate_networks() for [('7d240cfb-7e7d-4f20-90ad-58260429d0d8', None, None, None, None, None)] {{(pid=120384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:35:23.311054 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Flavor limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:35:23.311475 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Image limits 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:35:23.311948 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Flavor pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:35:23.312355 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Image pref 0:0:0 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:35:23.312763 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.virt.hardware [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:35:23.321784 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:23.322206 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:23.322666 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:23.323391 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:23.323844 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:23.324273 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:23.340902 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Getting quotas for project 1acee96791e54960abd4d9d1c735a298. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:35:23.344800 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.quota [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Getting quotas for user 79301dbf286e4b7d9fad34272a8002f5 and project 1acee96791e54960abd4d9d1c735a298. Resources: {'ram', 'cores', 'instances'} {{(pid=120384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:35:23.356214 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Going to run 1 instances... {{(pid=120384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:35:23.358508 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:35:23.412959 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-7a8d438f-d534-45fc-9518-67620ac8d083 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521677 Sep 13 03:35:23.414095 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 595/1223] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:35:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:35:23.424936 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-bb8b66a4-cf42-4109-8eca-380fef6f6921 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:23.425552 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-bb8b66a4-cf42-4109-8eca-380fef6f6921 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:23.486589 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-bb8b66a4-cf42-4109-8eca-380fef6f6921 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:23.494329 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-bb8b66a4-cf42-4109-8eca-380fef6f6921 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1213 microversion: 2.1 time: 0.073180 Sep 13 03:35:23.494905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 629/1224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:23 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:24.090528 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-cc7cd3d5-5f4b-4047-af3c-25f0056784cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:24.091279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-cc7cd3d5-5f4b-4047-af3c-25f0056784cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:24.097607 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cc7cd3d5-5f4b-4047-af3c-25f0056784cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:24.098289 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cc7cd3d5-5f4b-4047-af3c-25f0056784cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:24.098761 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cc7cd3d5-5f4b-4047-af3c-25f0056784cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:24.099458 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cc7cd3d5-5f4b-4047-af3c-25f0056784cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:24.099917 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cc7cd3d5-5f4b-4047-af3c-25f0056784cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:24.100340 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cc7cd3d5-5f4b-4047-af3c-25f0056784cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:24.125568 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-cc7cd3d5-5f4b-4047-af3c-25f0056784cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:35:24.205523 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-cc7cd3d5-5f4b-4047-af3c-25f0056784cb tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 204 len: 0 microversion: 2.1 time: 0.119869 Sep 13 03:35:24.206329 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 596/1225] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:35:24 2022] DELETE /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:35:24.215796 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f97803ba-9d4a-4c00-83cb-eae1ddd7ba93 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:24.217193 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f97803ba-9d4a-4c00-83cb-eae1ddd7ba93 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:24.224031 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f97803ba-9d4a-4c00-83cb-eae1ddd7ba93 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:24.224518 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f97803ba-9d4a-4c00-83cb-eae1ddd7ba93 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:24.224953 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f97803ba-9d4a-4c00-83cb-eae1ddd7ba93 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:24.225791 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f97803ba-9d4a-4c00-83cb-eae1ddd7ba93 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:24.226283 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f97803ba-9d4a-4c00-83cb-eae1ddd7ba93 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:24.226738 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f97803ba-9d4a-4c00-83cb-eae1ddd7ba93 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:24.353355 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f97803ba-9d4a-4c00-83cb-eae1ddd7ba93 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:24.360928 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f97803ba-9d4a-4c00-83cb-eae1ddd7ba93 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1554 microversion: 2.1 time: 0.150439 Sep 13 03:35:24.361482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 630/1226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:24 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:24.516699 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5d4188d6-9c10-47b7-89c7-459cd17dc14c tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:24.517399 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5d4188d6-9c10-47b7-89c7-459cd17dc14c tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:24.523348 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5d4188d6-9c10-47b7-89c7-459cd17dc14c tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:24.523830 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5d4188d6-9c10-47b7-89c7-459cd17dc14c tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:24.524260 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5d4188d6-9c10-47b7-89c7-459cd17dc14c tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:24.524938 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5d4188d6-9c10-47b7-89c7-459cd17dc14c tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:24.525389 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5d4188d6-9c10-47b7-89c7-459cd17dc14c tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:24.525808 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5d4188d6-9c10-47b7-89c7-459cd17dc14c tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:24.592199 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5d4188d6-9c10-47b7-89c7-459cd17dc14c tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:24.600560 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5d4188d6-9c10-47b7-89c7-459cd17dc14c tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1265 microversion: 2.1 time: 0.087976 Sep 13 03:35:24.602495 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 597/1227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:24 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:25.385194 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b36414f9-9902-4d6f-9d81-b8503ac5d9d6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:25.385738 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b36414f9-9902-4d6f-9d81-b8503ac5d9d6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:25.391597 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b36414f9-9902-4d6f-9d81-b8503ac5d9d6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:25.392079 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b36414f9-9902-4d6f-9d81-b8503ac5d9d6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:25.392511 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b36414f9-9902-4d6f-9d81-b8503ac5d9d6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:25.393220 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b36414f9-9902-4d6f-9d81-b8503ac5d9d6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:25.393668 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b36414f9-9902-4d6f-9d81-b8503ac5d9d6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:25.394086 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b36414f9-9902-4d6f-9d81-b8503ac5d9d6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:25.522552 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b36414f9-9902-4d6f-9d81-b8503ac5d9d6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:25.530890 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b36414f9-9902-4d6f-9d81-b8503ac5d9d6 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1554 microversion: 2.1 time: 0.150299 Sep 13 03:35:25.531449 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 631/1228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:25 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:25.625560 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-68bfc7c4-e16e-42ac-840f-f5cdb7c3a14b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:25.626169 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-68bfc7c4-e16e-42ac-840f-f5cdb7c3a14b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:25.632477 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-68bfc7c4-e16e-42ac-840f-f5cdb7c3a14b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:25.632965 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-68bfc7c4-e16e-42ac-840f-f5cdb7c3a14b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:25.633399 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-68bfc7c4-e16e-42ac-840f-f5cdb7c3a14b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:25.634572 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-68bfc7c4-e16e-42ac-840f-f5cdb7c3a14b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:25.635052 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-68bfc7c4-e16e-42ac-840f-f5cdb7c3a14b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:25.635520 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-68bfc7c4-e16e-42ac-840f-f5cdb7c3a14b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:25.695977 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-68bfc7c4-e16e-42ac-840f-f5cdb7c3a14b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:25.704166 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-68bfc7c4-e16e-42ac-840f-f5cdb7c3a14b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1265 microversion: 2.1 time: 0.082501 Sep 13 03:35:25.704729 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 598/1229] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:25 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:26.554664 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5167e8b0-23e6-40cf-a0e0-afda271920f0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:26.555198 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5167e8b0-23e6-40cf-a0e0-afda271920f0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:26.561636 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5167e8b0-23e6-40cf-a0e0-afda271920f0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:26.562118 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5167e8b0-23e6-40cf-a0e0-afda271920f0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:26.562555 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5167e8b0-23e6-40cf-a0e0-afda271920f0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:26.563262 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5167e8b0-23e6-40cf-a0e0-afda271920f0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:26.563715 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5167e8b0-23e6-40cf-a0e0-afda271920f0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:26.564141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5167e8b0-23e6-40cf-a0e0-afda271920f0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:26.687018 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5167e8b0-23e6-40cf-a0e0-afda271920f0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:26.694523 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5167e8b0-23e6-40cf-a0e0-afda271920f0 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1554 microversion: 2.1 time: 0.143922 Sep 13 03:35:26.695112 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 632/1230] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:26 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1554 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:26.726113 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-83847537-1ef2-450f-9164-f77859fd23a2 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:26.726750 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-83847537-1ef2-450f-9164-f77859fd23a2 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:26.737741 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-83847537-1ef2-450f-9164-f77859fd23a2 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:26.738223 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-83847537-1ef2-450f-9164-f77859fd23a2 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:26.738688 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-83847537-1ef2-450f-9164-f77859fd23a2 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:26.739368 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-83847537-1ef2-450f-9164-f77859fd23a2 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:26.739820 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-83847537-1ef2-450f-9164-f77859fd23a2 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:26.744102 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-83847537-1ef2-450f-9164-f77859fd23a2 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:26.804991 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-83847537-1ef2-450f-9164-f77859fd23a2 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:26.812463 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-83847537-1ef2-450f-9164-f77859fd23a2 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1271 microversion: 2.1 time: 0.090345 Sep 13 03:35:26.813022 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 599/1231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:26 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:27.715980 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-8c8a1378-b251-4b1b-961c-31026858250a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:27.716593 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-8c8a1378-b251-4b1b-961c-31026858250a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:27.722935 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8c8a1378-b251-4b1b-961c-31026858250a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:27.723419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8c8a1378-b251-4b1b-961c-31026858250a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:27.723851 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8c8a1378-b251-4b1b-961c-31026858250a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:27.724533 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8c8a1378-b251-4b1b-961c-31026858250a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:27.724981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8c8a1378-b251-4b1b-961c-31026858250a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:27.725400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-8c8a1378-b251-4b1b-961c-31026858250a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:27.835216 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a94b9334-02cb-43ed-aa94-8eabc6e34c62 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:27.835822 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a94b9334-02cb-43ed-aa94-8eabc6e34c62 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:27.842101 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a94b9334-02cb-43ed-aa94-8eabc6e34c62 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:27.842580 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a94b9334-02cb-43ed-aa94-8eabc6e34c62 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:27.843039 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a94b9334-02cb-43ed-aa94-8eabc6e34c62 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:27.843724 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a94b9334-02cb-43ed-aa94-8eabc6e34c62 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:27.844172 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a94b9334-02cb-43ed-aa94-8eabc6e34c62 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:27.844594 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a94b9334-02cb-43ed-aa94-8eabc6e34c62 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:27.848563 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:27.855171 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-8c8a1378-b251-4b1b-961c-31026858250a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:27.862834 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-8c8a1378-b251-4b1b-961c-31026858250a tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1554 microversion: 2.1 time: 0.150565 Sep 13 03:35:27.863528 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 633/1232] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:27 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:27.908831 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-a94b9334-02cb-43ed-aa94-8eabc6e34c62 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:27.917040 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a94b9334-02cb-43ed-aa94-8eabc6e34c62 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1271 microversion: 2.1 time: 0.085671 Sep 13 03:35:27.917597 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 600/1233] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:27 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:35:28.888655 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-f2fc5fe3-a06a-40c5-aadb-7380a47ba274 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:28.889269 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-f2fc5fe3-a06a-40c5-aadb-7380a47ba274 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:28.895597 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2fc5fe3-a06a-40c5-aadb-7380a47ba274 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:28.896080 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2fc5fe3-a06a-40c5-aadb-7380a47ba274 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:28.896515 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2fc5fe3-a06a-40c5-aadb-7380a47ba274 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:28.897230 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2fc5fe3-a06a-40c5-aadb-7380a47ba274 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:28.897683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2fc5fe3-a06a-40c5-aadb-7380a47ba274 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:28.898106 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-f2fc5fe3-a06a-40c5-aadb-7380a47ba274 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:28.939817 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c140f928-d130-4013-9eed-c5f1af85b72f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:28.940431 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c140f928-d130-4013-9eed-c5f1af85b72f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:28.942671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:28.948476 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c140f928-d130-4013-9eed-c5f1af85b72f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:28.948961 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c140f928-d130-4013-9eed-c5f1af85b72f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:28.949392 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c140f928-d130-4013-9eed-c5f1af85b72f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:28.950083 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c140f928-d130-4013-9eed-c5f1af85b72f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:28.950531 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c140f928-d130-4013-9eed-c5f1af85b72f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:28.950974 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c140f928-d130-4013-9eed-c5f1af85b72f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:29.015208 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c140f928-d130-4013-9eed-c5f1af85b72f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:29.022685 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c140f928-d130-4013-9eed-c5f1af85b72f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1271 microversion: 2.1 time: 0.086591 Sep 13 03:35:29.023249 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 601/1234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:28 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:35:29.029583 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-f2fc5fe3-a06a-40c5-aadb-7380a47ba274 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:29.037466 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-f2fc5fe3-a06a-40c5-aadb-7380a47ba274 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1554 microversion: 2.1 time: 0.152725 Sep 13 03:35:29.038150 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 634/1235] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:28 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:30.045346 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-bd84c097-d5a1-46b2-8830-207a1a3af452 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:30.045951 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-bd84c097-d5a1-46b2-8830-207a1a3af452 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:30.052304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bd84c097-d5a1-46b2-8830-207a1a3af452 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:30.052781 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bd84c097-d5a1-46b2-8830-207a1a3af452 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:30.053284 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bd84c097-d5a1-46b2-8830-207a1a3af452 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:30.053947 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bd84c097-d5a1-46b2-8830-207a1a3af452 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:30.054396 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bd84c097-d5a1-46b2-8830-207a1a3af452 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:30.054840 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bd84c097-d5a1-46b2-8830-207a1a3af452 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:30.060586 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d164cff8-ead1-4c8f-bff9-22262be492c1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:30.061308 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d164cff8-ead1-4c8f-bff9-22262be492c1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:30.064916 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=37 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:30.069214 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d164cff8-ead1-4c8f-bff9-22262be492c1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:30.069714 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d164cff8-ead1-4c8f-bff9-22262be492c1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:30.070161 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d164cff8-ead1-4c8f-bff9-22262be492c1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:30.071390 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d164cff8-ead1-4c8f-bff9-22262be492c1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:30.071856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d164cff8-ead1-4c8f-bff9-22262be492c1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:30.072287 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d164cff8-ead1-4c8f-bff9-22262be492c1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:30.077274 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=89 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:30.123562 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-bd84c097-d5a1-46b2-8830-207a1a3af452 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:30.131063 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-bd84c097-d5a1-46b2-8830-207a1a3af452 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1271 microversion: 2.1 time: 0.089535 Sep 13 03:35:30.132022 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 602/1236] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:30 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:30.289199 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-d164cff8-ead1-4c8f-bff9-22262be492c1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:30.297030 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d164cff8-ead1-4c8f-bff9-22262be492c1 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1554 microversion: 2.1 time: 0.240386 Sep 13 03:35:30.297536 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 635/1237] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:30 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:35:31.153762 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c2c2dd14-6905-426f-9989-b78588877e0b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:31.154990 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c2c2dd14-6905-426f-9989-b78588877e0b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:31.161795 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2c2dd14-6905-426f-9989-b78588877e0b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:31.162293 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2c2dd14-6905-426f-9989-b78588877e0b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:31.162957 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2c2dd14-6905-426f-9989-b78588877e0b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:31.163657 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2c2dd14-6905-426f-9989-b78588877e0b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:31.164120 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2c2dd14-6905-426f-9989-b78588877e0b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:31.164637 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c2c2dd14-6905-426f-9989-b78588877e0b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:31.304963 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c2c2dd14-6905-426f-9989-b78588877e0b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:31.312976 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c2c2dd14-6905-426f-9989-b78588877e0b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1313 microversion: 2.1 time: 0.163523 Sep 13 03:35:31.323808 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-1eb05be1-85bd-4b36-9f32-9db75465a2bf tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:31.325279 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-1eb05be1-85bd-4b36-9f32-9db75465a2bf tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:31.327171 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 603/1238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:31 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:31.337905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1eb05be1-85bd-4b36-9f32-9db75465a2bf tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:31.338470 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1eb05be1-85bd-4b36-9f32-9db75465a2bf tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:31.338944 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1eb05be1-85bd-4b36-9f32-9db75465a2bf tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:31.339824 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1eb05be1-85bd-4b36-9f32-9db75465a2bf tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:31.340301 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1eb05be1-85bd-4b36-9f32-9db75465a2bf tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:31.340732 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-1eb05be1-85bd-4b36-9f32-9db75465a2bf tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:31.634660 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-1eb05be1-85bd-4b36-9f32-9db75465a2bf tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92bba932a70f4a75b1bb1810d8826447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d0f9365a60474590ea1bb78b1654b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:31.642354 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-1eb05be1-85bd-4b36-9f32-9db75465a2bf tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 200 len: 1554 microversion: 2.1 time: 0.325658 Sep 13 03:35:31.642962 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 636/1239] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:31 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 1554 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:35:31.810458 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-c5633398-df0c-41b9-b43a-96bb27540141 req-0f7a0626-c0de-4cf4-99c6-82e7aaf4d2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c5c35a-9c3f-4796-a202-214bcff70431", "name": "network-vif-deleted", "tag": "fd8213ce-3653-4272-bd22-22e80d1944df"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:35:31.821811 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-c5633398-df0c-41b9-b43a-96bb27540141 req-0f7a0626-c0de-4cf4-99c6-82e7aaf4d2db service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:31.822292 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-c5633398-df0c-41b9-b43a-96bb27540141 req-0f7a0626-c0de-4cf4-99c6-82e7aaf4d2db service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:31.822749 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-c5633398-df0c-41b9-b43a-96bb27540141 req-0f7a0626-c0de-4cf4-99c6-82e7aaf4d2db service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:31.834032 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-c5633398-df0c-41b9-b43a-96bb27540141 req-0f7a0626-c0de-4cf4-99c6-82e7aaf4d2db service nova] Creating event network-vif-deleted:fd8213ce-3653-4272-bd22-22e80d1944df for instance d4c5c35a-9c3f-4796-a202-214bcff70431 on hv-cinder-85707 Sep 13 03:35:31.839914 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-c5633398-df0c-41b9-b43a-96bb27540141 req-0f7a0626-c0de-4cf4-99c6-82e7aaf4d2db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034152 Sep 13 03:35:31.841693 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 604/1240] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:32.337961 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-88e48629-b049-4f80-abe6-a92a6868c507 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:32.338505 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-88e48629-b049-4f80-abe6-a92a6868c507 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:32.344759 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-88e48629-b049-4f80-abe6-a92a6868c507 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:32.345238 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-88e48629-b049-4f80-abe6-a92a6868c507 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:32.345670 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-88e48629-b049-4f80-abe6-a92a6868c507 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:32.346351 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-88e48629-b049-4f80-abe6-a92a6868c507 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:32.346832 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-88e48629-b049-4f80-abe6-a92a6868c507 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:32.347250 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-88e48629-b049-4f80-abe6-a92a6868c507 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:32.667431 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2ddf9cf7-2acf-41fb-b041-68b5c8cafb6f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:32.668444 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2ddf9cf7-2acf-41fb-b041-68b5c8cafb6f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] [instance: d4c5c35a-9c3f-4796-a202-214bcff70431] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:32.675865 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ddf9cf7-2acf-41fb-b041-68b5c8cafb6f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:32.676803 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ddf9cf7-2acf-41fb-b041-68b5c8cafb6f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:32.677464 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ddf9cf7-2acf-41fb-b041-68b5c8cafb6f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:32.679382 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ddf9cf7-2acf-41fb-b041-68b5c8cafb6f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:32.681758 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ddf9cf7-2acf-41fb-b041-68b5c8cafb6f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:32.682445 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ddf9cf7-2acf-41fb-b041-68b5c8cafb6f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:32.702852 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-2ddf9cf7-2acf-41fb-b041-68b5c8cafb6f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] HTTP exception thrown: Instance d4c5c35a-9c3f-4796-a202-214bcff70431 could not be found. Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2ddf9cf7-2acf-41fb-b041-68b5c8cafb6f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Request method failure captured: Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 HTTP/1.1 Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_k9bSgeqk-czjg1Xpx1JwXJA8AEUOadR8hmIJ81cp-kb4aK9-WU4_VB3akG01ysCdlJB0f_hfZq1VCY8Da1d7YWFixYqt6JVGBUDSlJjy6wxp9nEfVNUI-pUAK1H665YGtf2sbYzMlq2IhqFx1pE99ZfE-R4lNqbwfd2kWqBIqMAGM Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 35d0f9365a60474590ea1bb78b1654b2 Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-TestMinimumBasicScenario-88233642 Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:35:32.705018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:35:32.706841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/35d0f9365a60474590ea1bb78b1654b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_35d0f9365a60474590ea1bb78b1654b2", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35d0f9365a60474590ea1bb78b1654b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35d0f9365a60474590ea1bb78b1654b2"}]}] Sep 13 03:35:32.706841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-TestMinimumBasicScenario-88233642 Sep 13 03:35:32.706841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 35d0f9365a60474590ea1bb78b1654b2 Sep 13 03:35:32.706841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-TestMinimumBasicScenario-88233642 Sep 13 03:35:32.706841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-TestMinimumBasicScenario-88233642-project Sep 13 03:35:32.706841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:35:32.706841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:35:32.706841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 92bba932a70f4a75b1bb1810d8826447 Sep 13 03:35:32.706841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-TestMinimumBasicScenario-88233642-project Sep 13 03:35:32.706841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:35:32.706841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance d4c5c35a-9c3f-4796-a202-214bcff70431 could not be found. Sep 13 03:35:32.706841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': 'd4c5c35a-9c3f-4796-a202-214bcff70431'} Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4c5c35a-9c3f-4796-a202-214bcff70431 could not be found. Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:35:32.707875 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c5c35a-9c3f-4796-a202-214bcff70431 could not be found. Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c5c35a-9c3f-4796-a202-214bcff70431 could not be found. Sep 13 03:35:32.709721 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:35:32.711255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2ddf9cf7-2acf-41fb-b041-68b5c8cafb6f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Returning 404 to user: Instance d4c5c35a-9c3f-4796-a202-214bcff70431 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:35:32.711255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2ddf9cf7-2acf-41fb-b041-68b5c8cafb6f tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431" status: 404 len: 111 microversion: 2.1 time: 0.044403 Sep 13 03:35:32.711255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 605/1241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:32 2022] GET /compute/v2.1/servers/d4c5c35a-9c3f-4796-a202-214bcff70431 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 03:35:32.719658 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-356d8eeb-31cd-4368-9e53-05a08114f777 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] Calling method '.version_select at 0x7f89356a2280>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:32.750982 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-356d8eeb-31cd-4368-9e53-05a08114f777 tempest-TestMinimumBasicScenario-88233642 tempest-TestMinimumBasicScenario-88233642-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1347009506" status: 202 len: 0 microversion: 2.1 time: 0.035205 Sep 13 03:35:32.751643 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 606/1242] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Sep 13 03:35:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1347009506 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:35:32.877284 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-88e48629-b049-4f80-abe6-a92a6868c507 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:32.886297 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-88e48629-b049-4f80-abe6-a92a6868c507 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1313 microversion: 2.1 time: 0.552820 Sep 13 03:35:32.887141 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 637/1243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:32 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:33.855769 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-a386b261-2620-480f-b1f2-f3b27bdc07ae req-4b6de4f9-8be2-4c2f-a148-fe1fc491d1cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "497f0fd2-2b9c-4df0-bf77-ada003d0682c", "tag": "94a6701d-0822-4e62-a31a-ac3fde274b5f"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:35:33.863338 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:33.863338 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=6 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:33.870255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-a386b261-2620-480f-b1f2-f3b27bdc07ae req-4b6de4f9-8be2-4c2f-a148-fe1fc491d1cb service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:33.870725 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-a386b261-2620-480f-b1f2-f3b27bdc07ae req-4b6de4f9-8be2-4c2f-a148-fe1fc491d1cb service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:33.871198 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-a386b261-2620-480f-b1f2-f3b27bdc07ae req-4b6de4f9-8be2-4c2f-a148-fe1fc491d1cb service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:33.883745 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-a386b261-2620-480f-b1f2-f3b27bdc07ae req-4b6de4f9-8be2-4c2f-a148-fe1fc491d1cb service nova] Creating event network-changed:94a6701d-0822-4e62-a31a-ac3fde274b5f for instance 497f0fd2-2b9c-4df0-bf77-ada003d0682c on hv-cinder-85707 Sep 13 03:35:33.889390 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-a386b261-2620-480f-b1f2-f3b27bdc07ae req-4b6de4f9-8be2-4c2f-a148-fe1fc491d1cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037238 Sep 13 03:35:33.890305 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 607/1244] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:33.909245 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-640de355-540d-48e4-a68e-cbd95874763a tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:33.909857 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-640de355-540d-48e4-a68e-cbd95874763a tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:33.914005 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:33.921121 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-640de355-540d-48e4-a68e-cbd95874763a tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:33.921653 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-640de355-540d-48e4-a68e-cbd95874763a tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:33.922239 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-640de355-540d-48e4-a68e-cbd95874763a tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:33.923079 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-640de355-540d-48e4-a68e-cbd95874763a tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:33.924350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-640de355-540d-48e4-a68e-cbd95874763a tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:33.924831 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-640de355-540d-48e4-a68e-cbd95874763a tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:34.077561 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-640de355-540d-48e4-a68e-cbd95874763a tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:34.085369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-640de355-540d-48e4-a68e-cbd95874763a tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1313 microversion: 2.1 time: 0.179907 Sep 13 03:35:34.085966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 638/1245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:33 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:35.109759 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-56a474d3-c68e-46c7-abbb-710d81970c7b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:35.111029 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-56a474d3-c68e-46c7-abbb-710d81970c7b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:35.122896 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-56a474d3-c68e-46c7-abbb-710d81970c7b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:35.123717 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-56a474d3-c68e-46c7-abbb-710d81970c7b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:35.124441 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-56a474d3-c68e-46c7-abbb-710d81970c7b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:35.125797 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-56a474d3-c68e-46c7-abbb-710d81970c7b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:35.126469 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-56a474d3-c68e-46c7-abbb-710d81970c7b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:35.127566 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-56a474d3-c68e-46c7-abbb-710d81970c7b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:35.386545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-56a474d3-c68e-46c7-abbb-710d81970c7b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:35.396792 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-56a474d3-c68e-46c7-abbb-710d81970c7b tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1313 microversion: 2.1 time: 0.292181 Sep 13 03:35:35.416628 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 608/1246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:35 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:36.422022 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-a1804846-88c0-4530-8d68-83177a28b987 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:36.422835 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-a1804846-88c0-4530-8d68-83177a28b987 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:36.429735 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a1804846-88c0-4530-8d68-83177a28b987 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:36.430525 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a1804846-88c0-4530-8d68-83177a28b987 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:36.431151 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a1804846-88c0-4530-8d68-83177a28b987 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:36.432015 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a1804846-88c0-4530-8d68-83177a28b987 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:36.432648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a1804846-88c0-4530-8d68-83177a28b987 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:36.433345 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-a1804846-88c0-4530-8d68-83177a28b987 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:36.678381 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-a1804846-88c0-4530-8d68-83177a28b987 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:36.686899 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-a1804846-88c0-4530-8d68-83177a28b987 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1313 microversion: 2.1 time: 0.269015 Sep 13 03:35:36.703964 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 639/1247] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:36 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:37.711910 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-3f4f2f3a-1669-4b4a-a9b8-0f33fd71a167 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:37.712528 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-3f4f2f3a-1669-4b4a-a9b8-0f33fd71a167 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:37.718916 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f4f2f3a-1669-4b4a-a9b8-0f33fd71a167 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:37.719407 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f4f2f3a-1669-4b4a-a9b8-0f33fd71a167 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:37.720179 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f4f2f3a-1669-4b4a-a9b8-0f33fd71a167 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:37.720883 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f4f2f3a-1669-4b4a-a9b8-0f33fd71a167 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:37.721348 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f4f2f3a-1669-4b4a-a9b8-0f33fd71a167 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:37.721777 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-3f4f2f3a-1669-4b4a-a9b8-0f33fd71a167 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:37.932960 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-3f4f2f3a-1669-4b4a-a9b8-0f33fd71a167 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:37.941457 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-3f4f2f3a-1669-4b4a-a9b8-0f33fd71a167 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1313 microversion: 2.1 time: 0.233456 Sep 13 03:35:37.942031 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 609/1248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:37 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:38.470162 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-eea48708-1d18-4784-a1cb-bbb4c565bb26 req-5b6a2aad-202b-4fd2-be1a-e41da9c420d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497f0fd2-2b9c-4df0-bf77-ada003d0682c", "name": "network-vif-plugged", "status": "completed", "tag": "94a6701d-0822-4e62-a31a-ac3fde274b5f"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:35:38.482945 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-eea48708-1d18-4784-a1cb-bbb4c565bb26 req-5b6a2aad-202b-4fd2-be1a-e41da9c420d4 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:38.483461 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-eea48708-1d18-4784-a1cb-bbb4c565bb26 req-5b6a2aad-202b-4fd2-be1a-e41da9c420d4 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:38.484198 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-eea48708-1d18-4784-a1cb-bbb4c565bb26 req-5b6a2aad-202b-4fd2-be1a-e41da9c420d4 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:38.496747 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-eea48708-1d18-4784-a1cb-bbb4c565bb26 req-5b6a2aad-202b-4fd2-be1a-e41da9c420d4 service nova] Creating event network-vif-plugged:94a6701d-0822-4e62-a31a-ac3fde274b5f for instance 497f0fd2-2b9c-4df0-bf77-ada003d0682c on hv-cinder-85707 Sep 13 03:35:38.501998 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-eea48708-1d18-4784-a1cb-bbb4c565bb26 req-5b6a2aad-202b-4fd2-be1a-e41da9c420d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037063 Sep 13 03:35:38.502727 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 640/1249] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:38.965639 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-cd15f7b0-e4c5-4255-a93b-51308624601f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:38.967330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-cd15f7b0-e4c5-4255-a93b-51308624601f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:38.976783 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cd15f7b0-e4c5-4255-a93b-51308624601f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:38.977750 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cd15f7b0-e4c5-4255-a93b-51308624601f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:38.978412 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cd15f7b0-e4c5-4255-a93b-51308624601f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:38.979426 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cd15f7b0-e4c5-4255-a93b-51308624601f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:38.980106 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cd15f7b0-e4c5-4255-a93b-51308624601f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:38.980884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cd15f7b0-e4c5-4255-a93b-51308624601f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:39.226454 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-cd15f7b0-e4c5-4255-a93b-51308624601f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:39.236299 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-cd15f7b0-e4c5-4255-a93b-51308624601f tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1313 microversion: 2.1 time: 0.275726 Sep 13 03:35:39.236868 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 610/1250] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:38 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:40.260949 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-e85d9898-385d-4de9-b9d2-04db57426c87 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:40.262017 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-e85d9898-385d-4de9-b9d2-04db57426c87 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:40.274955 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e85d9898-385d-4de9-b9d2-04db57426c87 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:40.276472 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e85d9898-385d-4de9-b9d2-04db57426c87 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:40.277383 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e85d9898-385d-4de9-b9d2-04db57426c87 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:40.279136 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e85d9898-385d-4de9-b9d2-04db57426c87 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:40.280062 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e85d9898-385d-4de9-b9d2-04db57426c87 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:40.280664 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-e85d9898-385d-4de9-b9d2-04db57426c87 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:40.536939 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-e85d9898-385d-4de9-b9d2-04db57426c87 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:40.552419 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-e85d9898-385d-4de9-b9d2-04db57426c87 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1313 microversion: 2.1 time: 0.298016 Sep 13 03:35:40.553382 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 641/1251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:40 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:41.576722 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c97e8071-d04b-4e68-8fc2-4d5dfeb99726 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:41.577348 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c97e8071-d04b-4e68-8fc2-4d5dfeb99726 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:41.583914 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c97e8071-d04b-4e68-8fc2-4d5dfeb99726 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:41.584418 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c97e8071-d04b-4e68-8fc2-4d5dfeb99726 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:41.584862 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c97e8071-d04b-4e68-8fc2-4d5dfeb99726 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:41.585589 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c97e8071-d04b-4e68-8fc2-4d5dfeb99726 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:41.586058 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c97e8071-d04b-4e68-8fc2-4d5dfeb99726 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:41.587846 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c97e8071-d04b-4e68-8fc2-4d5dfeb99726 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:41.750003 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c97e8071-d04b-4e68-8fc2-4d5dfeb99726 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:41.759288 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c97e8071-d04b-4e68-8fc2-4d5dfeb99726 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1497 microversion: 2.1 time: 0.186487 Sep 13 03:35:41.771003 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 611/1252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:41 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:42.238156 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-0b4d2a69-23a4-4a74-9c87-7aabd019eef5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:42.238712 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0b4d2a69-23a4-4a74-9c87-7aabd019eef5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:42.245566 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0b4d2a69-23a4-4a74-9c87-7aabd019eef5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:42.246055 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0b4d2a69-23a4-4a74-9c87-7aabd019eef5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:42.246480 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0b4d2a69-23a4-4a74-9c87-7aabd019eef5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:42.247200 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0b4d2a69-23a4-4a74-9c87-7aabd019eef5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:42.247652 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0b4d2a69-23a4-4a74-9c87-7aabd019eef5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:42.248074 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-0b4d2a69-23a4-4a74-9c87-7aabd019eef5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:42.272664 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-0b4d2a69-23a4-4a74-9c87-7aabd019eef5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Going to try to terminate instance {{(pid=120383) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:35:42.345208 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-0b4d2a69-23a4-4a74-9c87-7aabd019eef5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "DELETE /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 204 len: 0 microversion: 2.1 time: 0.110312 Sep 13 03:35:42.354691 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 642/1253] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:35:42 2022] DELETE /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:35:42.355920 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6ac45c2f-1fa0-4a5a-b4b6-f89fbbd9f7a3 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:42.356687 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6ac45c2f-1fa0-4a5a-b4b6-f89fbbd9f7a3 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:42.362736 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6ac45c2f-1fa0-4a5a-b4b6-f89fbbd9f7a3 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:42.363220 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6ac45c2f-1fa0-4a5a-b4b6-f89fbbd9f7a3 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:42.363647 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6ac45c2f-1fa0-4a5a-b4b6-f89fbbd9f7a3 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:42.364340 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6ac45c2f-1fa0-4a5a-b4b6-f89fbbd9f7a3 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:42.364771 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6ac45c2f-1fa0-4a5a-b4b6-f89fbbd9f7a3 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:42.365187 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-6ac45c2f-1fa0-4a5a-b4b6-f89fbbd9f7a3 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:42.493298 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-6ac45c2f-1fa0-4a5a-b4b6-f89fbbd9f7a3 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:42.500840 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6ac45c2f-1fa0-4a5a-b4b6-f89fbbd9f7a3 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1503 microversion: 2.1 time: 0.149484 Sep 13 03:35:42.501396 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 612/1254] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:42 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:35:43.525345 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-5d86e50f-cdae-4d11-92d8-3285b25943f4 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:43.526040 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-5d86e50f-cdae-4d11-92d8-3285b25943f4 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:43.532326 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5d86e50f-cdae-4d11-92d8-3285b25943f4 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:43.532808 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5d86e50f-cdae-4d11-92d8-3285b25943f4 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:43.533241 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5d86e50f-cdae-4d11-92d8-3285b25943f4 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:43.533925 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5d86e50f-cdae-4d11-92d8-3285b25943f4 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:43.534378 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5d86e50f-cdae-4d11-92d8-3285b25943f4 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:43.534905 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-5d86e50f-cdae-4d11-92d8-3285b25943f4 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:43.666979 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-5d86e50f-cdae-4d11-92d8-3285b25943f4 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:43.674798 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-5d86e50f-cdae-4d11-92d8-3285b25943f4 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1503 microversion: 2.1 time: 0.154290 Sep 13 03:35:43.675369 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 643/1255] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:43 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:44.451279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-e6af058c-5cc2-4393-a85e-f47c2bc49efb req-71ce841e-2981-48e4-85ab-3c04acfde609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497f0fd2-2b9c-4df0-bf77-ada003d0682c", "name": "network-vif-deleted", "tag": "94a6701d-0822-4e62-a31a-ac3fde274b5f"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:35:44.462216 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-e6af058c-5cc2-4393-a85e-f47c2bc49efb req-71ce841e-2981-48e4-85ab-3c04acfde609 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:44.462738 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-e6af058c-5cc2-4393-a85e-f47c2bc49efb req-71ce841e-2981-48e4-85ab-3c04acfde609 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:44.463163 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-e6af058c-5cc2-4393-a85e-f47c2bc49efb req-71ce841e-2981-48e4-85ab-3c04acfde609 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:44.474172 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-e6af058c-5cc2-4393-a85e-f47c2bc49efb req-71ce841e-2981-48e4-85ab-3c04acfde609 service nova] Creating event network-vif-deleted:94a6701d-0822-4e62-a31a-ac3fde274b5f for instance 497f0fd2-2b9c-4df0-bf77-ada003d0682c on hv-cinder-85707 Sep 13 03:35:44.480543 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-e6af058c-5cc2-4393-a85e-f47c2bc49efb req-71ce841e-2981-48e4-85ab-3c04acfde609 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032676 Sep 13 03:35:44.481241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 613/1256] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:44.696974 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:44.697580 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:44.704063 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:44.704545 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:44.704971 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:44.705648 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:44.706094 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:44.706510 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:44.737542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:44.738015 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:44.738445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:44.738913 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lazy-loading 'fault' on Instance uuid 497f0fd2-2b9c-4df0-bf77-ada003d0682c {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:35:44.778594 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:44.786291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-40a7741a-e835-4b39-9dad-c9d43621df53 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 200 len: 1303 microversion: 2.1 time: 0.093043 Sep 13 03:35:44.786872 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 644/1257] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:44 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:45.810290 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2ca364d4-8d4c-4a4b-b774-30c2f1e18f65 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:45.811031 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2ca364d4-8d4c-4a4b-b774-30c2f1e18f65 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 497f0fd2-2b9c-4df0-bf77-ada003d0682c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:45.817072 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ca364d4-8d4c-4a4b-b774-30c2f1e18f65 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:45.817552 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ca364d4-8d4c-4a4b-b774-30c2f1e18f65 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:45.817985 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ca364d4-8d4c-4a4b-b774-30c2f1e18f65 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:45.818693 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ca364d4-8d4c-4a4b-b774-30c2f1e18f65 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:45.819145 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ca364d4-8d4c-4a4b-b774-30c2f1e18f65 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:45.819567 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2ca364d4-8d4c-4a4b-b774-30c2f1e18f65 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:45.832852 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-2ca364d4-8d4c-4a4b-b774-30c2f1e18f65 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] HTTP exception thrown: Instance 497f0fd2-2b9c-4df0-bf77-ada003d0682c could not be found. Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2ca364d4-8d4c-4a4b-b774-30c2f1e18f65 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Request method failure captured: Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c HTTP/1.1 Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_p4Xyh2u4k7U5bMes7XiDJlrR4mLR7W3OiC1lMOhLLxkyqCUp3_zdYJUBKMimFaBuYgcPzzka_btBZCDZUGs-b6mbOsWntoQweEx4EOjoa4_Jc16hdL-d7j-N6KCNa8_KFdK_3HCVAmXBia165GTP_0A2XkwZb43ShIAKBPDeC78Pw Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 1acee96791e54960abd4d9d1c735a298 Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-VolumesActionsTest-663160473 Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:35:45.834421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:35:45.836236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1acee96791e54960abd4d9d1c735a298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1acee96791e54960abd4d9d1c735a298", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1acee96791e54960abd4d9d1c735a298"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1acee96791e54960abd4d9d1c735a298"}]}] Sep 13 03:35:45.836236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-VolumesActionsTest-663160473 Sep 13 03:35:45.836236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 1acee96791e54960abd4d9d1c735a298 Sep 13 03:35:45.836236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-VolumesActionsTest-663160473 Sep 13 03:35:45.836236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-VolumesActionsTest-663160473-project Sep 13 03:35:45.836236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:35:45.836236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:35:45.836236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 79301dbf286e4b7d9fad34272a8002f5 Sep 13 03:35:45.836236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-VolumesActionsTest-663160473-project Sep 13 03:35:45.836236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:35:45.836236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance 497f0fd2-2b9c-4df0-bf77-ada003d0682c could not be found. Sep 13 03:35:45.836236 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': '497f0fd2-2b9c-4df0-bf77-ada003d0682c'} Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 497f0fd2-2b9c-4df0-bf77-ada003d0682c could not be found. Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:35:45.837279 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497f0fd2-2b9c-4df0-bf77-ada003d0682c could not be found. Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497f0fd2-2b9c-4df0-bf77-ada003d0682c could not be found. Sep 13 03:35:45.839588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:35:45.841124 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2ca364d4-8d4c-4a4b-b774-30c2f1e18f65 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Returning 404 to user: Instance 497f0fd2-2b9c-4df0-bf77-ada003d0682c could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:35:45.841124 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2ca364d4-8d4c-4a4b-b774-30c2f1e18f65 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c" status: 404 len: 111 microversion: 2.1 time: 0.030276 Sep 13 03:35:45.841124 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 614/1258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:45 2022] GET /compute/v2.1/servers/497f0fd2-2b9c-4df0-bf77-ada003d0682c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:35:45.934278 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1364777786", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452", "networks": [{"uuid": "7d240cfb-7e7d-4f20-90ad-58260429d0d8"}]}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:35:46.148381 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.network.neutron [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] validate_networks() for [('7d240cfb-7e7d-4f20-90ad-58260429d0d8', None, None, None, None, None)] {{(pid=120383) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:35:46.594281 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Flavor limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:35:46.594772 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Image limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:35:46.595251 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Flavor pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:35:46.595665 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Image pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:35:46.596079 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:35:46.605337 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:46.605824 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:46.606267 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:46.607016 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:46.607476 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:46.607904 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:46.624840 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Getting quotas for project 1acee96791e54960abd4d9d1c735a298. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:35:46.628761 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Getting quotas for user 79301dbf286e4b7d9fad34272a8002f5 and project 1acee96791e54960abd4d9d1c735a298. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:35:46.639590 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Going to run 1 instances... {{(pid=120383) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:35:46.641865 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:35:46.688817 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-02889efd-067e-4428-bdd1-7eee0ef237bd tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758827 Sep 13 03:35:46.689462 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 645/1259] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:35:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:35:46.700512 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-98a7af64-aca9-494a-b2bd-c82fb9af1cb1 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:46.701207 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-98a7af64-aca9-494a-b2bd-c82fb9af1cb1 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:46.754438 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-98a7af64-aca9-494a-b2bd-c82fb9af1cb1 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:46.761461 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-98a7af64-aca9-494a-b2bd-c82fb9af1cb1 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1214 microversion: 2.1 time: 0.064756 Sep 13 03:35:46.762027 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 615/1260] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:46 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:47.785352 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6f377b61-ff76-4473-bcc1-64d05576a4c0 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:47.786728 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6f377b61-ff76-4473-bcc1-64d05576a4c0 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:47.794387 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f377b61-ff76-4473-bcc1-64d05576a4c0 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:47.794929 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f377b61-ff76-4473-bcc1-64d05576a4c0 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:47.795353 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f377b61-ff76-4473-bcc1-64d05576a4c0 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:47.796072 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f377b61-ff76-4473-bcc1-64d05576a4c0 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:47.796525 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f377b61-ff76-4473-bcc1-64d05576a4c0 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:47.796948 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6f377b61-ff76-4473-bcc1-64d05576a4c0 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:47.870627 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6f377b61-ff76-4473-bcc1-64d05576a4c0 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:47.879236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6f377b61-ff76-4473-bcc1-64d05576a4c0 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1284 microversion: 2.1 time: 0.098711 Sep 13 03:35:47.879857 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 646/1261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:47 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:48.902380 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-94bc2aaf-5e33-4af5-bc5f-b70ff290405e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:48.903100 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-94bc2aaf-5e33-4af5-bc5f-b70ff290405e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:48.910653 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-94bc2aaf-5e33-4af5-bc5f-b70ff290405e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:48.911152 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-94bc2aaf-5e33-4af5-bc5f-b70ff290405e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:48.911588 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-94bc2aaf-5e33-4af5-bc5f-b70ff290405e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:48.912310 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-94bc2aaf-5e33-4af5-bc5f-b70ff290405e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:48.912765 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-94bc2aaf-5e33-4af5-bc5f-b70ff290405e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:48.913314 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-94bc2aaf-5e33-4af5-bc5f-b70ff290405e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:49.096757 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-94bc2aaf-5e33-4af5-bc5f-b70ff290405e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:49.104989 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-94bc2aaf-5e33-4af5-bc5f-b70ff290405e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1314 microversion: 2.1 time: 0.207528 Sep 13 03:35:49.105559 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 616/1262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:48 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:49.125821 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-032ec79b-6a6e-4951-8a19-f7af886232a7 req-27af3066-49d8-4b26-bf20-cdb835ec353d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc9e70b-233d-4b0b-ae27-192cae0f81c9", "tag": "c4c61bde-56af-4090-98a0-71de92549a53"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:35:49.136465 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-032ec79b-6a6e-4951-8a19-f7af886232a7 req-27af3066-49d8-4b26-bf20-cdb835ec353d service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:49.136949 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-032ec79b-6a6e-4951-8a19-f7af886232a7 req-27af3066-49d8-4b26-bf20-cdb835ec353d service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:49.137377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-032ec79b-6a6e-4951-8a19-f7af886232a7 req-27af3066-49d8-4b26-bf20-cdb835ec353d service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:49.147956 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-032ec79b-6a6e-4951-8a19-f7af886232a7 req-27af3066-49d8-4b26-bf20-cdb835ec353d service nova] Creating event network-changed:c4c61bde-56af-4090-98a0-71de92549a53 for instance 4cc9e70b-233d-4b0b-ae27-192cae0f81c9 on hv-cinder-85707 Sep 13 03:35:49.152945 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-032ec79b-6a6e-4951-8a19-f7af886232a7 req-27af3066-49d8-4b26-bf20-cdb835ec353d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030676 Sep 13 03:35:49.153722 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 647/1263] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:50.128587 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c88a6941-2943-4096-9e7e-cd0500be5738 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:50.129235 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c88a6941-2943-4096-9e7e-cd0500be5738 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:50.136146 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c88a6941-2943-4096-9e7e-cd0500be5738 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:50.136638 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c88a6941-2943-4096-9e7e-cd0500be5738 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:50.137078 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c88a6941-2943-4096-9e7e-cd0500be5738 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:50.137773 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c88a6941-2943-4096-9e7e-cd0500be5738 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:50.138235 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c88a6941-2943-4096-9e7e-cd0500be5738 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:50.138700 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c88a6941-2943-4096-9e7e-cd0500be5738 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:50.269209 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c88a6941-2943-4096-9e7e-cd0500be5738 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:50.277340 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c88a6941-2943-4096-9e7e-cd0500be5738 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1314 microversion: 2.1 time: 0.152645 Sep 13 03:35:50.277898 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 617/1264] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:50 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:51.300767 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-abc59ff0-35fc-4bca-bf39-1f40a449ad66 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:51.301461 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-abc59ff0-35fc-4bca-bf39-1f40a449ad66 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:51.307737 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-abc59ff0-35fc-4bca-bf39-1f40a449ad66 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:51.308236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-abc59ff0-35fc-4bca-bf39-1f40a449ad66 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:51.308713 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-abc59ff0-35fc-4bca-bf39-1f40a449ad66 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:51.309393 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-abc59ff0-35fc-4bca-bf39-1f40a449ad66 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:51.309841 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-abc59ff0-35fc-4bca-bf39-1f40a449ad66 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:51.310261 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-abc59ff0-35fc-4bca-bf39-1f40a449ad66 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:51.437395 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-abc59ff0-35fc-4bca-bf39-1f40a449ad66 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:51.444954 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-abc59ff0-35fc-4bca-bf39-1f40a449ad66 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1314 microversion: 2.1 time: 0.148841 Sep 13 03:35:51.445509 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 648/1265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:51 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:35:52.468436 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-14b0e74e-cfd3-4d00-bb6d-79676789c861 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:52.469076 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-14b0e74e-cfd3-4d00-bb6d-79676789c861 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:52.475361 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-14b0e74e-cfd3-4d00-bb6d-79676789c861 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:52.475852 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-14b0e74e-cfd3-4d00-bb6d-79676789c861 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:52.476289 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-14b0e74e-cfd3-4d00-bb6d-79676789c861 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:52.476987 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-14b0e74e-cfd3-4d00-bb6d-79676789c861 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:52.477446 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-14b0e74e-cfd3-4d00-bb6d-79676789c861 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:52.477882 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-14b0e74e-cfd3-4d00-bb6d-79676789c861 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:52.607773 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-14b0e74e-cfd3-4d00-bb6d-79676789c861 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:52.615671 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-14b0e74e-cfd3-4d00-bb6d-79676789c861 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1314 microversion: 2.1 time: 0.151108 Sep 13 03:35:52.616247 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 618/1266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:52 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:53.637982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-02d900b8-5000-4f3d-8977-bf1670ca38c5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:53.638591 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-02d900b8-5000-4f3d-8977-bf1670ca38c5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:53.644919 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02d900b8-5000-4f3d-8977-bf1670ca38c5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:53.645400 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02d900b8-5000-4f3d-8977-bf1670ca38c5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:53.645830 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02d900b8-5000-4f3d-8977-bf1670ca38c5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:53.646508 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02d900b8-5000-4f3d-8977-bf1670ca38c5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:53.646978 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02d900b8-5000-4f3d-8977-bf1670ca38c5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:53.647397 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-02d900b8-5000-4f3d-8977-bf1670ca38c5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:53.772651 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-02d900b8-5000-4f3d-8977-bf1670ca38c5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:53.780788 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-02d900b8-5000-4f3d-8977-bf1670ca38c5 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1314 microversion: 2.1 time: 0.146671 Sep 13 03:35:53.781348 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 649/1267] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:53 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:54.513509 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-c845ea61-22bf-477f-a10b-137e960064c4 req-a1762b5d-df43-4a83-81a7-d90e53c83748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc9e70b-233d-4b0b-ae27-192cae0f81c9", "name": "network-vif-plugged", "status": "completed", "tag": "c4c61bde-56af-4090-98a0-71de92549a53"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:35:54.524063 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-c845ea61-22bf-477f-a10b-137e960064c4 req-a1762b5d-df43-4a83-81a7-d90e53c83748 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:54.524548 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-c845ea61-22bf-477f-a10b-137e960064c4 req-a1762b5d-df43-4a83-81a7-d90e53c83748 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:54.524972 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-c845ea61-22bf-477f-a10b-137e960064c4 req-a1762b5d-df43-4a83-81a7-d90e53c83748 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:54.536459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-c845ea61-22bf-477f-a10b-137e960064c4 req-a1762b5d-df43-4a83-81a7-d90e53c83748 service nova] Creating event network-vif-plugged:c4c61bde-56af-4090-98a0-71de92549a53 for instance 4cc9e70b-233d-4b0b-ae27-192cae0f81c9 on hv-cinder-85707 Sep 13 03:35:54.541879 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-c845ea61-22bf-477f-a10b-137e960064c4 req-a1762b5d-df43-4a83-81a7-d90e53c83748 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032699 Sep 13 03:35:54.542484 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 619/1268] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:35:54.802265 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-fd378301-54e0-4d9d-8647-e65624ff3c25 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:54.802901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-fd378301-54e0-4d9d-8647-e65624ff3c25 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:54.809506 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fd378301-54e0-4d9d-8647-e65624ff3c25 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:54.810002 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fd378301-54e0-4d9d-8647-e65624ff3c25 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:54.810433 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fd378301-54e0-4d9d-8647-e65624ff3c25 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:54.811180 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fd378301-54e0-4d9d-8647-e65624ff3c25 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:54.811629 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fd378301-54e0-4d9d-8647-e65624ff3c25 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:54.812045 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-fd378301-54e0-4d9d-8647-e65624ff3c25 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:54.940227 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-fd378301-54e0-4d9d-8647-e65624ff3c25 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:54.947828 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-fd378301-54e0-4d9d-8647-e65624ff3c25 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1314 microversion: 2.1 time: 0.149342 Sep 13 03:35:54.948383 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 650/1269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:54 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:55.970839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-05067926-549a-47d1-8219-390a7167e234 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:55.971613 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-05067926-549a-47d1-8219-390a7167e234 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:55.977913 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-05067926-549a-47d1-8219-390a7167e234 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:55.978396 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-05067926-549a-47d1-8219-390a7167e234 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:55.979429 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-05067926-549a-47d1-8219-390a7167e234 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:55.980155 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-05067926-549a-47d1-8219-390a7167e234 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:55.980599 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-05067926-549a-47d1-8219-390a7167e234 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:55.981020 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-05067926-549a-47d1-8219-390a7167e234 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:56.111205 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-05067926-549a-47d1-8219-390a7167e234 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:56.119018 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-05067926-549a-47d1-8219-390a7167e234 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1314 microversion: 2.1 time: 0.152706 Sep 13 03:35:56.119617 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 620/1270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:55 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:57.141060 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-ca35258c-e81e-4bc1-ba6d-af584999ad14 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:57.141683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-ca35258c-e81e-4bc1-ba6d-af584999ad14 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:57.144074 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:57.144730 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=6 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:57.151611 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ca35258c-e81e-4bc1-ba6d-af584999ad14 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:57.152102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ca35258c-e81e-4bc1-ba6d-af584999ad14 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:57.152567 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ca35258c-e81e-4bc1-ba6d-af584999ad14 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:57.153257 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ca35258c-e81e-4bc1-ba6d-af584999ad14 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:57.153712 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ca35258c-e81e-4bc1-ba6d-af584999ad14 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:57.154160 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-ca35258c-e81e-4bc1-ba6d-af584999ad14 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:57.282759 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-ca35258c-e81e-4bc1-ba6d-af584999ad14 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:57.285200 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:57.292859 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-ca35258c-e81e-4bc1-ba6d-af584999ad14 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1497 microversion: 2.1 time: 0.155691 Sep 13 03:35:57.293421 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 651/1271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:57 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:57.845824 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-788f7e71-746b-4735-9b80-83f104caccde tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:57.846347 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-788f7e71-746b-4735-9b80-83f104caccde tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:57.849256 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:57.854184 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-788f7e71-746b-4735-9b80-83f104caccde tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:57.854693 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-788f7e71-746b-4735-9b80-83f104caccde tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:57.855127 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-788f7e71-746b-4735-9b80-83f104caccde tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:57.855824 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-788f7e71-746b-4735-9b80-83f104caccde tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:57.856278 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-788f7e71-746b-4735-9b80-83f104caccde tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:57.856701 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-788f7e71-746b-4735-9b80-83f104caccde tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:57.875497 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=92 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:57.883639 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-788f7e71-746b-4735-9b80-83f104caccde tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:35:57.959664 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-788f7e71-746b-4735-9b80-83f104caccde tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 204 len: 0 microversion: 2.1 time: 0.117289 Sep 13 03:35:57.963929 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 621/1272] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:35:57 2022] DELETE /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:35:57.969753 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-00c81e4d-d07e-42c8-9c60-746e92a13889 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:57.970445 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-00c81e4d-d07e-42c8-9c60-746e92a13889 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:57.977366 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00c81e4d-d07e-42c8-9c60-746e92a13889 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:57.977845 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00c81e4d-d07e-42c8-9c60-746e92a13889 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:57.978280 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00c81e4d-d07e-42c8-9c60-746e92a13889 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:57.981131 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00c81e4d-d07e-42c8-9c60-746e92a13889 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:57.981612 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00c81e4d-d07e-42c8-9c60-746e92a13889 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:57.982045 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-00c81e4d-d07e-42c8-9c60-746e92a13889 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:58.414143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-00c81e4d-d07e-42c8-9c60-746e92a13889 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:58.423253 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-00c81e4d-d07e-42c8-9c60-746e92a13889 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1503 microversion: 2.1 time: 0.457883 Sep 13 03:35:58.423822 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 652/1273] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:57 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1503 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:58.805055 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-872ffe88-3e1c-472e-b70b-1690674e6ed6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:58.805769 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-872ffe88-3e1c-472e-b70b-1690674e6ed6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:58.806228 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-53b91128-b3d9-4db6-83b0-d174e234bd84 req-ab34f8d0-614f-46e9-8f6a-64a755306eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e452a83d-d2f5-4167-89b8-f02e61173b84", "tag": "5eb326a8-8417-4b1c-a306-3720fd092e50"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:35:58.811987 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-872ffe88-3e1c-472e-b70b-1690674e6ed6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:58.812583 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-872ffe88-3e1c-472e-b70b-1690674e6ed6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:58.813237 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-872ffe88-3e1c-472e-b70b-1690674e6ed6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:58.814241 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-872ffe88-3e1c-472e-b70b-1690674e6ed6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:58.814835 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-872ffe88-3e1c-472e-b70b-1690674e6ed6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:58.815356 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-872ffe88-3e1c-472e-b70b-1690674e6ed6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:58.816294 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-53b91128-b3d9-4db6-83b0-d174e234bd84 req-ab34f8d0-614f-46e9-8f6a-64a755306eb1 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:58.816782 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-53b91128-b3d9-4db6-83b0-d174e234bd84 req-ab34f8d0-614f-46e9-8f6a-64a755306eb1 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:58.817218 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-53b91128-b3d9-4db6-83b0-d174e234bd84 req-ab34f8d0-614f-46e9-8f6a-64a755306eb1 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:58.828585 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-53b91128-b3d9-4db6-83b0-d174e234bd84 req-ab34f8d0-614f-46e9-8f6a-64a755306eb1 service nova] Creating event network-changed:5eb326a8-8417-4b1c-a306-3720fd092e50 for instance e452a83d-d2f5-4167-89b8-f02e61173b84 on hv-cinder-85707 Sep 13 03:35:58.834117 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-53b91128-b3d9-4db6-83b0-d174e234bd84 req-ab34f8d0-614f-46e9-8f6a-64a755306eb1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031494 Sep 13 03:35:58.835049 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 653/1274] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:35:58.843874 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-872ffe88-3e1c-472e-b70b-1690674e6ed6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:35:58.920204 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-872ffe88-3e1c-472e-b70b-1690674e6ed6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 204 len: 0 microversion: 2.1 time: 0.119152 Sep 13 03:35:58.920936 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 622/1275] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:35:58 2022] DELETE /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:35:58.930305 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-48cbc744-92e1-4a93-acf0-13b1929076ea tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:58.931028 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-48cbc744-92e1-4a93-acf0-13b1929076ea tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:58.937199 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-48cbc744-92e1-4a93-acf0-13b1929076ea tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:58.937683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-48cbc744-92e1-4a93-acf0-13b1929076ea tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:58.938111 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-48cbc744-92e1-4a93-acf0-13b1929076ea tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:58.938820 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-48cbc744-92e1-4a93-acf0-13b1929076ea tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:58.939271 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-48cbc744-92e1-4a93-acf0-13b1929076ea tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:58.939697 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-48cbc744-92e1-4a93-acf0-13b1929076ea tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:59.077715 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-48cbc744-92e1-4a93-acf0-13b1929076ea tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:59.088592 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-48cbc744-92e1-4a93-acf0-13b1929076ea tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1576 microversion: 2.1 time: 0.161823 Sep 13 03:35:59.089646 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 654/1276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:58 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:35:59.447816 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-926ac1f3-6bb6-43e9-9d51-708dfc01c22d tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:35:59.448751 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-926ac1f3-6bb6-43e9-9d51-708dfc01c22d tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:35:59.450711 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:59.455921 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-926ac1f3-6bb6-43e9-9d51-708dfc01c22d tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:59.456416 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-926ac1f3-6bb6-43e9-9d51-708dfc01c22d tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:59.456850 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-926ac1f3-6bb6-43e9-9d51-708dfc01c22d tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:59.457544 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-926ac1f3-6bb6-43e9-9d51-708dfc01c22d tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:35:59.458004 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-926ac1f3-6bb6-43e9-9d51-708dfc01c22d tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:35:59.458425 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-926ac1f3-6bb6-43e9-9d51-708dfc01c22d tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:35:59.594237 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-926ac1f3-6bb6-43e9-9d51-708dfc01c22d tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:35:59.602731 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-926ac1f3-6bb6-43e9-9d51-708dfc01c22d tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1503 microversion: 2.1 time: 0.159708 Sep 13 03:35:59.603308 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 623/1277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:35:59 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:00.112250 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-345d4770-fc13-45a3-ab1a-fc2009ea24a8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:00.112968 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-345d4770-fc13-45a3-ab1a-fc2009ea24a8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:00.115377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:00.121416 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-345d4770-fc13-45a3-ab1a-fc2009ea24a8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:00.121904 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-345d4770-fc13-45a3-ab1a-fc2009ea24a8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:00.122344 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-345d4770-fc13-45a3-ab1a-fc2009ea24a8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:00.123059 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-345d4770-fc13-45a3-ab1a-fc2009ea24a8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:00.123517 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-345d4770-fc13-45a3-ab1a-fc2009ea24a8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:00.123943 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-345d4770-fc13-45a3-ab1a-fc2009ea24a8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:00.257509 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-345d4770-fc13-45a3-ab1a-fc2009ea24a8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:00.265318 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-345d4770-fc13-45a3-ab1a-fc2009ea24a8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1576 microversion: 2.1 time: 0.156949 Sep 13 03:36:00.265886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 655/1278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:00 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:00.625563 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-898d3c11-3ee9-4030-b03b-7b663f6eb20e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:00.626176 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-898d3c11-3ee9-4030-b03b-7b663f6eb20e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:00.632644 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-898d3c11-3ee9-4030-b03b-7b663f6eb20e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:00.633128 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-898d3c11-3ee9-4030-b03b-7b663f6eb20e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:00.633564 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-898d3c11-3ee9-4030-b03b-7b663f6eb20e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:00.634247 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-898d3c11-3ee9-4030-b03b-7b663f6eb20e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:00.635229 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-898d3c11-3ee9-4030-b03b-7b663f6eb20e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:00.635650 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-898d3c11-3ee9-4030-b03b-7b663f6eb20e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:00.761770 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-898d3c11-3ee9-4030-b03b-7b663f6eb20e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:00.769510 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-898d3c11-3ee9-4030-b03b-7b663f6eb20e tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1503 microversion: 2.1 time: 0.147798 Sep 13 03:36:00.770080 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 624/1279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:00 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:01.289122 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-4926dfac-96f2-43bd-a18c-5902f9a293d1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:01.289737 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-4926dfac-96f2-43bd-a18c-5902f9a293d1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:01.297236 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4926dfac-96f2-43bd-a18c-5902f9a293d1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:01.299245 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4926dfac-96f2-43bd-a18c-5902f9a293d1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:01.299245 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4926dfac-96f2-43bd-a18c-5902f9a293d1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:01.299245 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4926dfac-96f2-43bd-a18c-5902f9a293d1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:01.299579 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4926dfac-96f2-43bd-a18c-5902f9a293d1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:01.301051 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-4926dfac-96f2-43bd-a18c-5902f9a293d1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:01.619900 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-4926dfac-96f2-43bd-a18c-5902f9a293d1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:01.631719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-4926dfac-96f2-43bd-a18c-5902f9a293d1 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 200 len: 1576 microversion: 2.1 time: 0.346607 Sep 13 03:36:01.632989 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 656/1280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:01 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 1576 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:01.680839 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-9f8ea086-5dcb-4595-9fc7-b0f009e56d2e req-7215af90-8e99-44cc-9c44-772f53c6e1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e452a83d-d2f5-4167-89b8-f02e61173b84", "name": "network-vif-deleted", "tag": "5eb326a8-8417-4b1c-a306-3720fd092e50"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:36:01.691773 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-9f8ea086-5dcb-4595-9fc7-b0f009e56d2e req-7215af90-8e99-44cc-9c44-772f53c6e1e9 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:01.692256 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-9f8ea086-5dcb-4595-9fc7-b0f009e56d2e req-7215af90-8e99-44cc-9c44-772f53c6e1e9 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:01.692684 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-9f8ea086-5dcb-4595-9fc7-b0f009e56d2e req-7215af90-8e99-44cc-9c44-772f53c6e1e9 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:01.703957 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-9f8ea086-5dcb-4595-9fc7-b0f009e56d2e req-7215af90-8e99-44cc-9c44-772f53c6e1e9 service nova] Creating event network-vif-deleted:5eb326a8-8417-4b1c-a306-3720fd092e50 for instance e452a83d-d2f5-4167-89b8-f02e61173b84 on hv-cinder-85707 Sep 13 03:36:01.709459 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-9f8ea086-5dcb-4595-9fc7-b0f009e56d2e req-7215af90-8e99-44cc-9c44-772f53c6e1e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032159 Sep 13 03:36:01.710339 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 625/1281] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:36:01.793363 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b070defd-15e8-4150-b37c-e7a4d5e6ed93 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:01.793976 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b070defd-15e8-4150-b37c-e7a4d5e6ed93 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:01.800571 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b070defd-15e8-4150-b37c-e7a4d5e6ed93 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:01.801073 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b070defd-15e8-4150-b37c-e7a4d5e6ed93 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:01.801510 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b070defd-15e8-4150-b37c-e7a4d5e6ed93 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:01.802232 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b070defd-15e8-4150-b37c-e7a4d5e6ed93 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:01.802745 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b070defd-15e8-4150-b37c-e7a4d5e6ed93 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:01.803159 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b070defd-15e8-4150-b37c-e7a4d5e6ed93 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:01.898792 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b070defd-15e8-4150-b37c-e7a4d5e6ed93 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:01.907022 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b070defd-15e8-4150-b37c-e7a4d5e6ed93 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1461 microversion: 2.1 time: 0.118248 Sep 13 03:36:01.907586 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 657/1282] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:01 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1461 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:01.952096 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-26382068-7bdc-4b54-aab7-64134d6ff999 req-ec4553af-3cca-4efe-aec9-c933c058b0cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc9e70b-233d-4b0b-ae27-192cae0f81c9", "name": "network-vif-deleted", "tag": "c4c61bde-56af-4090-98a0-71de92549a53"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:36:01.967269 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-26382068-7bdc-4b54-aab7-64134d6ff999 req-ec4553af-3cca-4efe-aec9-c933c058b0cf service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:01.968057 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-26382068-7bdc-4b54-aab7-64134d6ff999 req-ec4553af-3cca-4efe-aec9-c933c058b0cf service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:01.968560 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-26382068-7bdc-4b54-aab7-64134d6ff999 req-ec4553af-3cca-4efe-aec9-c933c058b0cf service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:01.982363 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-26382068-7bdc-4b54-aab7-64134d6ff999 req-ec4553af-3cca-4efe-aec9-c933c058b0cf service nova] Creating event network-vif-deleted:c4c61bde-56af-4090-98a0-71de92549a53 for instance 4cc9e70b-233d-4b0b-ae27-192cae0f81c9 on hv-cinder-85707 Sep 13 03:36:01.989044 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-26382068-7bdc-4b54-aab7-64134d6ff999 req-ec4553af-3cca-4efe-aec9-c933c058b0cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040850 Sep 13 03:36:01.989710 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 626/1283] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:36:02.655736 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3bb1534c-42b4-4999-a2da-0e0763dce7f8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:02.656350 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-3bb1534c-42b4-4999-a2da-0e0763dce7f8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e452a83d-d2f5-4167-89b8-f02e61173b84] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:02.662969 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3bb1534c-42b4-4999-a2da-0e0763dce7f8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:02.663457 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3bb1534c-42b4-4999-a2da-0e0763dce7f8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:02.663897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3bb1534c-42b4-4999-a2da-0e0763dce7f8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:02.664583 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3bb1534c-42b4-4999-a2da-0e0763dce7f8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:02.665038 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3bb1534c-42b4-4999-a2da-0e0763dce7f8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:02.665463 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-3bb1534c-42b4-4999-a2da-0e0763dce7f8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:02.680607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-3bb1534c-42b4-4999-a2da-0e0763dce7f8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] HTTP exception thrown: Instance e452a83d-d2f5-4167-89b8-f02e61173b84 could not be found. Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3bb1534c-42b4-4999-a2da-0e0763dce7f8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Request method failure captured: Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 HTTP/1.1 Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_hDpEhAK4darfXwyYbk_uq8BYyVeujtIvO_YriX6f8mOb-iEWBo4kPVBm36oim4Z6uU64Mka6geIXfi1Y7R7QtU_MRuTpkXWu2xsvlIvcQZiQx6sS_bG5FdNG46X3D46zCMKcNPvb_itPTyDQcQ3ODos5jE-1ey9zFPuqBF8IW2K4s Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: ab6c92ba81254caaad368fd0ef382b0e Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:36:02.682754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:36:02.684607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab6c92ba81254caaad368fd0ef382b0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab6c92ba81254caaad368fd0ef382b0e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab6c92ba81254caaad368fd0ef382b0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab6c92ba81254caaad368fd0ef382b0e"}]}] Sep 13 03:36:02.684607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:36:02.684607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: ab6c92ba81254caaad368fd0ef382b0e Sep 13 03:36:02.684607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:36:02.684607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-TestVolumeBootPattern-1706251283-project Sep 13 03:36:02.684607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:36:02.684607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:36:02.684607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 47fa1f7ce54145ceb3564b9ba7b4964f Sep 13 03:36:02.684607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-TestVolumeBootPattern-1706251283-project Sep 13 03:36:02.684607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:36:02.684607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance e452a83d-d2f5-4167-89b8-f02e61173b84 could not be found. Sep 13 03:36:02.684607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'e452a83d-d2f5-4167-89b8-f02e61173b84'} Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e452a83d-d2f5-4167-89b8-f02e61173b84 could not be found. Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:36:02.685633 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e452a83d-d2f5-4167-89b8-f02e61173b84 could not be found. Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e452a83d-d2f5-4167-89b8-f02e61173b84 could not be found. Sep 13 03:36:02.687313 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:02.688933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-3bb1534c-42b4-4999-a2da-0e0763dce7f8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Returning 404 to user: Instance e452a83d-d2f5-4167-89b8-f02e61173b84 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:36:02.688933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-3bb1534c-42b4-4999-a2da-0e0763dce7f8 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84" status: 404 len: 111 microversion: 2.1 time: 0.032244 Sep 13 03:36:02.688933 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 658/1284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:02 2022] GET /compute/v2.1/servers/e452a83d-d2f5-4167-89b8-f02e61173b84 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:36:02.932492 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:02.933201 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:02.939304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:02.939834 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:02.940255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:02.940949 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:02.941404 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:02.941841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:02.974257 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:02.974844 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:02.975353 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:02.975817 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.objects.instance [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lazy-loading 'fault' on Instance uuid 4cc9e70b-233d-4b0b-ae27-192cae0f81c9 {{(pid=120384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:36:03.019262 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79301dbf286e4b7d9fad34272a8002f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acee96791e54960abd4d9d1c735a298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:03.027013 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-bc6d6b21-410d-4039-8b93-651436837373 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 200 len: 1304 microversion: 2.1 time: 0.099464 Sep 13 03:36:03.027706 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 627/1285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:02 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:04.049854 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-44524d08-03c9-4254-9f71-352ca5220822 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:04.050392 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-44524d08-03c9-4254-9f71-352ca5220822 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] [instance: 4cc9e70b-233d-4b0b-ae27-192cae0f81c9] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:04.057275 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-44524d08-03c9-4254-9f71-352ca5220822 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:04.057766 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-44524d08-03c9-4254-9f71-352ca5220822 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:04.058201 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-44524d08-03c9-4254-9f71-352ca5220822 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:04.058907 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-44524d08-03c9-4254-9f71-352ca5220822 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:04.059362 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-44524d08-03c9-4254-9f71-352ca5220822 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:04.059788 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-44524d08-03c9-4254-9f71-352ca5220822 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:04.073749 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-44524d08-03c9-4254-9f71-352ca5220822 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] HTTP exception thrown: Instance 4cc9e70b-233d-4b0b-ae27-192cae0f81c9 could not be found. Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-44524d08-03c9-4254-9f71-352ca5220822 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Request method failure captured: Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 HTTP/1.1 Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_p4Xyh2u4k7U5bMes7XiDJlrR4mLR7W3OiC1lMOhLLxkyqCUp3_zdYJUBKMimFaBuYgcPzzka_btBZCDZUGs-b6mbOsWntoQweEx4EOjoa4_Jc16hdL-d7j-N6KCNa8_KFdK_3HCVAmXBia165GTP_0A2XkwZb43ShIAKBPDeC78Pw Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: 1acee96791e54960abd4d9d1c735a298 Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-VolumesActionsTest-663160473 Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:36:04.075291 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:36:04.076982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1acee96791e54960abd4d9d1c735a298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1acee96791e54960abd4d9d1c735a298", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1acee96791e54960abd4d9d1c735a298"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1acee96791e54960abd4d9d1c735a298"}]}] Sep 13 03:36:04.076982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-VolumesActionsTest-663160473 Sep 13 03:36:04.076982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: 1acee96791e54960abd4d9d1c735a298 Sep 13 03:36:04.076982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-VolumesActionsTest-663160473 Sep 13 03:36:04.076982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-VolumesActionsTest-663160473-project Sep 13 03:36:04.076982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:36:04.076982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:36:04.076982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 79301dbf286e4b7d9fad34272a8002f5 Sep 13 03:36:04.076982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-VolumesActionsTest-663160473-project Sep 13 03:36:04.076982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:36:04.076982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance 4cc9e70b-233d-4b0b-ae27-192cae0f81c9 could not be found. Sep 13 03:36:04.076982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': '4cc9e70b-233d-4b0b-ae27-192cae0f81c9'} Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc9e70b-233d-4b0b-ae27-192cae0f81c9 could not be found. Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:36:04.078255 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc9e70b-233d-4b0b-ae27-192cae0f81c9 could not be found. Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc9e70b-233d-4b0b-ae27-192cae0f81c9 could not be found. Sep 13 03:36:04.079895 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:04.081377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-44524d08-03c9-4254-9f71-352ca5220822 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] Returning 404 to user: Instance 4cc9e70b-233d-4b0b-ae27-192cae0f81c9 could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:36:04.081377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-44524d08-03c9-4254-9f71-352ca5220822 tempest-VolumesActionsTest-663160473 tempest-VolumesActionsTest-663160473-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9" status: 404 len: 111 microversion: 2.1 time: 0.030807 Sep 13 03:36:04.081377 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 659/1286] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:04 2022] GET /compute/v2.1/servers/4cc9e70b-233d-4b0b-ae27-192cae0f81c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:36:05.756006 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-cbbe32d7-905e-4312-91e7-1c4d4d5466bc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:05.756538 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-cbbe32d7-905e-4312-91e7-1c4d4d5466bc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:05.758290 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-2a1bb66b-b978-4f16-b886-2bd33a538f71 req-068d1c63-c2f8-4c59-a332-513634c1ffde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47509aa-d316-494f-8446-a2f81a1f234c", "tag": "58cadb39-f080-4b49-bdc0-0bad103c6ae7"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:36:05.763680 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cbbe32d7-905e-4312-91e7-1c4d4d5466bc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:05.764173 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cbbe32d7-905e-4312-91e7-1c4d4d5466bc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:05.764610 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cbbe32d7-905e-4312-91e7-1c4d4d5466bc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:05.765317 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cbbe32d7-905e-4312-91e7-1c4d4d5466bc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:05.765771 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cbbe32d7-905e-4312-91e7-1c4d4d5466bc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:05.766192 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-cbbe32d7-905e-4312-91e7-1c4d4d5466bc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:05.769641 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2a1bb66b-b978-4f16-b886-2bd33a538f71 req-068d1c63-c2f8-4c59-a332-513634c1ffde service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:05.770409 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2a1bb66b-b978-4f16-b886-2bd33a538f71 req-068d1c63-c2f8-4c59-a332-513634c1ffde service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:05.771054 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-2a1bb66b-b978-4f16-b886-2bd33a538f71 req-068d1c63-c2f8-4c59-a332-513634c1ffde service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:05.782856 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-2a1bb66b-b978-4f16-b886-2bd33a538f71 req-068d1c63-c2f8-4c59-a332-513634c1ffde service nova] Creating event network-changed:58cadb39-f080-4b49-bdc0-0bad103c6ae7 for instance e47509aa-d316-494f-8446-a2f81a1f234c on hv-cinder-85707 Sep 13 03:36:05.788111 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-2a1bb66b-b978-4f16-b886-2bd33a538f71 req-068d1c63-c2f8-4c59-a332-513634c1ffde service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033568 Sep 13 03:36:05.788892 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 660/1287] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:36:05.792465 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-cbbe32d7-905e-4312-91e7-1c4d4d5466bc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Going to try to terminate instance {{(pid=120384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:36:05.875447 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-cbbe32d7-905e-4312-91e7-1c4d4d5466bc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 204 len: 0 microversion: 2.1 time: 0.122817 Sep 13 03:36:05.876208 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 628/1288] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:36:05 2022] DELETE /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:36:05.885298 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c58ca92b-01cb-4165-9218-6f6906ce50bf tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:05.886453 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c58ca92b-01cb-4165-9218-6f6906ce50bf tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:05.895570 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c58ca92b-01cb-4165-9218-6f6906ce50bf tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:05.896178 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c58ca92b-01cb-4165-9218-6f6906ce50bf tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:05.896702 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c58ca92b-01cb-4165-9218-6f6906ce50bf tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:05.897484 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c58ca92b-01cb-4165-9218-6f6906ce50bf tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:05.898139 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c58ca92b-01cb-4165-9218-6f6906ce50bf tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:05.898691 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c58ca92b-01cb-4165-9218-6f6906ce50bf tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:06.042164 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-c58ca92b-01cb-4165-9218-6f6906ce50bf tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:06.050732 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c58ca92b-01cb-4165-9218-6f6906ce50bf tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1576 microversion: 2.1 time: 0.170072 Sep 13 03:36:06.051536 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 661/1289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:05 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:07.077443 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-f1a93f7f-0c58-455f-9347-de264a24ff0b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:07.078137 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-f1a93f7f-0c58-455f-9347-de264a24ff0b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:07.084529 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1a93f7f-0c58-455f-9347-de264a24ff0b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:07.085020 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1a93f7f-0c58-455f-9347-de264a24ff0b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:07.085471 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1a93f7f-0c58-455f-9347-de264a24ff0b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:07.086515 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1a93f7f-0c58-455f-9347-de264a24ff0b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:07.086994 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1a93f7f-0c58-455f-9347-de264a24ff0b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:07.087415 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-f1a93f7f-0c58-455f-9347-de264a24ff0b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:07.221727 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-f1a93f7f-0c58-455f-9347-de264a24ff0b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:07.230176 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-f1a93f7f-0c58-455f-9347-de264a24ff0b tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1576 microversion: 2.1 time: 0.157595 Sep 13 03:36:07.230794 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 629/1290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:07 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:08.253820 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-35945103-e00b-45f9-a38e-38b2b4de2f3f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:08.254440 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-35945103-e00b-45f9-a38e-38b2b4de2f3f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:08.261642 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-35945103-e00b-45f9-a38e-38b2b4de2f3f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:08.262131 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-35945103-e00b-45f9-a38e-38b2b4de2f3f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:08.262576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-35945103-e00b-45f9-a38e-38b2b4de2f3f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:08.263288 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-35945103-e00b-45f9-a38e-38b2b4de2f3f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:08.263745 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-35945103-e00b-45f9-a38e-38b2b4de2f3f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:08.264175 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-35945103-e00b-45f9-a38e-38b2b4de2f3f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:08.391752 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-35945103-e00b-45f9-a38e-38b2b4de2f3f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:08.399396 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-35945103-e00b-45f9-a38e-38b2b4de2f3f tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1576 microversion: 2.1 time: 0.149430 Sep 13 03:36:08.399960 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 662/1291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:08 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:09.423517 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-b79131a3-d513-4eb7-b91c-1a3e9ce9c310 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:09.424133 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-b79131a3-d513-4eb7-b91c-1a3e9ce9c310 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:09.430753 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b79131a3-d513-4eb7-b91c-1a3e9ce9c310 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:09.431240 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b79131a3-d513-4eb7-b91c-1a3e9ce9c310 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:09.431679 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b79131a3-d513-4eb7-b91c-1a3e9ce9c310 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:09.432369 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b79131a3-d513-4eb7-b91c-1a3e9ce9c310 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:09.432828 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b79131a3-d513-4eb7-b91c-1a3e9ce9c310 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:09.433251 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-b79131a3-d513-4eb7-b91c-1a3e9ce9c310 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:09.562024 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-b79131a3-d513-4eb7-b91c-1a3e9ce9c310 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:09.569745 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-b79131a3-d513-4eb7-b91c-1a3e9ce9c310 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1576 microversion: 2.1 time: 0.150210 Sep 13 03:36:09.570311 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 630/1292] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:09 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:10.594424 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-39a778f4-7d98-4ade-8031-a74b36609afa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:10.595081 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-39a778f4-7d98-4ade-8031-a74b36609afa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:10.609067 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-39a778f4-7d98-4ade-8031-a74b36609afa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:10.610040 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-39a778f4-7d98-4ade-8031-a74b36609afa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:10.611328 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-39a778f4-7d98-4ade-8031-a74b36609afa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:10.612585 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-39a778f4-7d98-4ade-8031-a74b36609afa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:10.613456 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-39a778f4-7d98-4ade-8031-a74b36609afa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:10.614178 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-39a778f4-7d98-4ade-8031-a74b36609afa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:10.903383 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-39a778f4-7d98-4ade-8031-a74b36609afa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fa1f7ce54145ceb3564b9ba7b4964f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c92ba81254caaad368fd0ef382b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:10.912663 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-af4e83f5-d929-4720-a2dd-1876133d6b6a req-9234b06d-85c4-4e33-b3eb-584c4df40e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47509aa-d316-494f-8446-a2f81a1f234c", "name": "network-vif-deleted", "tag": "58cadb39-f080-4b49-bdc0-0bad103c6ae7"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:36:10.920080 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-39a778f4-7d98-4ade-8031-a74b36609afa tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 200 len: 1458 microversion: 2.1 time: 0.330079 Sep 13 03:36:10.921381 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 663/1293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:10 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 1458 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:10.923330 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-af4e83f5-d929-4720-a2dd-1876133d6b6a req-9234b06d-85c4-4e33-b3eb-584c4df40e67 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:10.924029 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-af4e83f5-d929-4720-a2dd-1876133d6b6a req-9234b06d-85c4-4e33-b3eb-584c4df40e67 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:10.924696 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-af4e83f5-d929-4720-a2dd-1876133d6b6a req-9234b06d-85c4-4e33-b3eb-584c4df40e67 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:10.939497 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-af4e83f5-d929-4720-a2dd-1876133d6b6a req-9234b06d-85c4-4e33-b3eb-584c4df40e67 service nova] Creating event network-vif-deleted:58cadb39-f080-4b49-bdc0-0bad103c6ae7 for instance e47509aa-d316-494f-8446-a2f81a1f234c on hv-cinder-85707 Sep 13 03:36:10.944884 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-af4e83f5-d929-4720-a2dd-1876133d6b6a req-9234b06d-85c4-4e33-b3eb-584c4df40e67 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036517 Sep 13 03:36:10.945880 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 631/1294] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 03:36:11.949493 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c6ade24a-5be3-4519-a1ac-2b6f56d65470 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:11.954303 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-c6ade24a-5be3-4519-a1ac-2b6f56d65470 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: e47509aa-d316-494f-8446-a2f81a1f234c] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:11.963414 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6ade24a-5be3-4519-a1ac-2b6f56d65470 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:11.963957 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6ade24a-5be3-4519-a1ac-2b6f56d65470 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:11.964718 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6ade24a-5be3-4519-a1ac-2b6f56d65470 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:11.965459 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6ade24a-5be3-4519-a1ac-2b6f56d65470 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:11.966370 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6ade24a-5be3-4519-a1ac-2b6f56d65470 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:11.966833 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-c6ade24a-5be3-4519-a1ac-2b6f56d65470 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:11.988237 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-c6ade24a-5be3-4519-a1ac-2b6f56d65470 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] HTTP exception thrown: Instance e47509aa-d316-494f-8446-a2f81a1f234c could not be found. Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c6ade24a-5be3-4519-a1ac-2b6f56d65470 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Request method failure captured: Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c HTTP/1.1 Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_hDpEhAK4darfXwyYbk_uq8BYyVeujtIvO_YriX6f8mOb-iEWBo4kPVBm36oim4Z6uU64Mka6geIXfi1Y7R7QtU_MRuTpkXWu2xsvlIvcQZiQx6sS_bG5FdNG46X3D46zCMKcNPvb_itPTyDQcQ3ODos5jE-1ey9zFPuqBF8IW2K4s Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: ab6c92ba81254caaad368fd0ef382b0e Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:36:11.990797 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:36:11.992774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab6c92ba81254caaad368fd0ef382b0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab6c92ba81254caaad368fd0ef382b0e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab6c92ba81254caaad368fd0ef382b0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab6c92ba81254caaad368fd0ef382b0e"}]}] Sep 13 03:36:11.992774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:36:11.992774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: ab6c92ba81254caaad368fd0ef382b0e Sep 13 03:36:11.992774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:36:11.992774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-TestVolumeBootPattern-1706251283-project Sep 13 03:36:11.992774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:36:11.992774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:36:11.992774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 47fa1f7ce54145ceb3564b9ba7b4964f Sep 13 03:36:11.992774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-TestVolumeBootPattern-1706251283-project Sep 13 03:36:11.992774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:36:11.992774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance e47509aa-d316-494f-8446-a2f81a1f234c could not be found. Sep 13 03:36:11.992774 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'e47509aa-d316-494f-8446-a2f81a1f234c'} Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e47509aa-d316-494f-8446-a2f81a1f234c could not be found. Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:36:11.993751 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e47509aa-d316-494f-8446-a2f81a1f234c could not be found. Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e47509aa-d316-494f-8446-a2f81a1f234c could not be found. Sep 13 03:36:11.996212 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:11.999101 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-c6ade24a-5be3-4519-a1ac-2b6f56d65470 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Returning 404 to user: Instance e47509aa-d316-494f-8446-a2f81a1f234c could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:36:11.999966 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-c6ade24a-5be3-4519-a1ac-2b6f56d65470 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c" status: 404 len: 111 microversion: 2.1 time: 0.058614 Sep 13 03:36:12.003653 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 664/1295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:11 2022] GET /compute/v2.1/servers/e47509aa-d316-494f-8446-a2f81a1f234c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:36:12.508793 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c8d39c80-39ad-45de-9690-06b79fd35fc6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:12.509374 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c8d39c80-39ad-45de-9690-06b79fd35fc6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:12.516083 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c8d39c80-39ad-45de-9690-06b79fd35fc6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:12.516568 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c8d39c80-39ad-45de-9690-06b79fd35fc6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:12.517216 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c8d39c80-39ad-45de-9690-06b79fd35fc6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:12.518096 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c8d39c80-39ad-45de-9690-06b79fd35fc6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:12.518541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c8d39c80-39ad-45de-9690-06b79fd35fc6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:12.519167 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c8d39c80-39ad-45de-9690-06b79fd35fc6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:12.535437 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-c8d39c80-39ad-45de-9690-06b79fd35fc6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] HTTP exception thrown: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c8d39c80-39ad-45de-9690-06b79fd35fc6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Request method failure captured: Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: DELETE /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef HTTP/1.1 Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_hDpEhAK4darfXwyYbk_uq8BYyVeujtIvO_YriX6f8mOb-iEWBo4kPVBm36oim4Z6uU64Mka6geIXfi1Y7R7QtU_MRuTpkXWu2xsvlIvcQZiQx6sS_bG5FdNG46X3D46zCMKcNPvb_itPTyDQcQ3ODos5jE-1ey9zFPuqBF8IW2K4s Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: ab6c92ba81254caaad368fd0ef382b0e Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:36:12.537093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:36:12.538863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab6c92ba81254caaad368fd0ef382b0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab6c92ba81254caaad368fd0ef382b0e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab6c92ba81254caaad368fd0ef382b0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab6c92ba81254caaad368fd0ef382b0e"}]}] Sep 13 03:36:12.538863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:36:12.538863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: ab6c92ba81254caaad368fd0ef382b0e Sep 13 03:36:12.538863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:36:12.538863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-TestVolumeBootPattern-1706251283-project Sep 13 03:36:12.538863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:36:12.538863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:36:12.538863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 47fa1f7ce54145ceb3564b9ba7b4964f Sep 13 03:36:12.538863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-TestVolumeBootPattern-1706251283-project Sep 13 03:36:12.538863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:36:12.538863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:36:12.538863 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': 'b4319ab9-e7a2-45ea-ae43-c9860ed33cef'} Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:36:12.539841 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:36:12.541924 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:36:12.544304 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c8d39c80-39ad-45de-9690-06b79fd35fc6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Returning 404 to user: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:36:12.545316 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c8d39c80-39ad-45de-9690-06b79fd35fc6 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 404 len: 111 microversion: 2.1 time: 0.041363 Sep 13 03:36:12.545865 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 632/1296] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:36:12 2022] DELETE /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 03:36:12.554102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-27e8b5ad-da89-467b-ac17-451c171f79cc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:12.554897 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-27e8b5ad-da89-467b-ac17-451c171f79cc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] [instance: b4319ab9-e7a2-45ea-ae43-c9860ed33cef] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:12.561875 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27e8b5ad-da89-467b-ac17-451c171f79cc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:12.562374 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27e8b5ad-da89-467b-ac17-451c171f79cc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:12.562885 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27e8b5ad-da89-467b-ac17-451c171f79cc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:12.563600 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27e8b5ad-da89-467b-ac17-451c171f79cc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:12.564046 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27e8b5ad-da89-467b-ac17-451c171f79cc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:12.564482 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-27e8b5ad-da89-467b-ac17-451c171f79cc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:12.578048 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.wsgi [None req-27e8b5ad-da89-467b-ac17-451c171f79cc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] HTTP exception thrown: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-27e8b5ad-da89-467b-ac17-451c171f79cc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Request method failure captured: Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: request: GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef HTTP/1.1 Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept: application/json Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Accept-Encoding: identity Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Connection: close Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Length: 0 Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Content-Type: application/json Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Host: 10.222.0.18 Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Openstack-System-Scope: None Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: User-Agent: python-urllib3/1.26.12 Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Auth-Token: gAAAAABjH_hDpEhAK4darfXwyYbk_uq8BYyVeujtIvO_YriX6f8mOb-iEWBo4kPVBm36oim4Z6uU64Mka6geIXfi1Y7R7QtU_MRuTpkXWu2xsvlIvcQZiQx6sS_bG5FdNG46X3D46zCMKcNPvb_itPTyDQcQ3ODos5jE-1ey9zFPuqBF8IW2K4s Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Id: None Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Domain-Name: None Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Identity-Status: Confirmed Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Is-Admin-Project: True Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Id: default Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Domain-Name: Default Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Id: ab6c92ba81254caaad368fd0ef382b0e Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Project-Name: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Role: reader,member Sep 13 03:36:12.579573 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Roles: reader,member Sep 13 03:36:12.581347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab6c92ba81254caaad368fd0ef382b0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab6c92ba81254caaad368fd0ef382b0e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab6c92ba81254caaad368fd0ef382b0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab6c92ba81254caaad368fd0ef382b0e"}]}] Sep 13 03:36:12.581347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:36:12.581347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Id: ab6c92ba81254caaad368fd0ef382b0e Sep 13 03:36:12.581347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-Tenant-Name: tempest-TestVolumeBootPattern-1706251283 Sep 13 03:36:12.581347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User: tempest-TestVolumeBootPattern-1706251283-project Sep 13 03:36:12.581347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Id: default Sep 13 03:36:12.581347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Domain-Name: Default Sep 13 03:36:12.581347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Id: 47fa1f7ce54145ceb3564b9ba7b4964f Sep 13 03:36:12.581347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: X-User-Name: tempest-TestVolumeBootPattern-1706251283-project Sep 13 03:36:12.581347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: method: > Sep 13 03:36:12.581347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: exception: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:36:12.581347 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: action_args: {'id': 'b4319ab9-e7a2-45ea-ae43-c9860ed33cef'} Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:36:12.582429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. Sep 13 03:36:12.584058 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: ERROR nova.api.openstack.wsgi Sep 13 03:36:12.585557 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-27e8b5ad-da89-467b-ac17-451c171f79cc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Returning 404 to user: Instance b4319ab9-e7a2-45ea-ae43-c9860ed33cef could not be found. {{(pid=120383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:36:12.586901 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-27e8b5ad-da89-467b-ac17-451c171f79cc tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef" status: 404 len: 111 microversion: 2.1 time: 0.036318 Sep 13 03:36:12.588194 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 665/1297] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:12 2022] GET /compute/v2.1/servers/b4319ab9-e7a2-45ea-ae43-c9860ed33cef => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 03:36:13.935978 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-e0ad87cc-355e-4e42-84ac-6cc51057c628 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] Calling method '.version_select at 0x7f89358f5af0>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:13.967553 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-e0ad87cc-355e-4e42-84ac-6cc51057c628 tempest-TestVolumeBootPattern-1706251283 tempest-TestVolumeBootPattern-1706251283-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-196387094" status: 202 len: 0 microversion: 2.1 time: 0.030188 Sep 13 03:36:13.971602 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 633/1298] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Sep 13 03:36:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-196387094 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 03:36:32.112402 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-184705358", "imageRef": "49d58309-5b6f-4b56-8999-a779f47b0a39", "flavorRef": "452"}} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:36:32.119710 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_api:SELECT=21 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:32.120341 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell1:SELECT=61 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:32.166683 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.network.neutron [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] validate_networks() for None {{(pid=120383) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 03:36:32.433669 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Flavor limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 03:36:32.434094 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Image limits 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 03:36:32.434725 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Flavor pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 03:36:32.435130 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Image pref 0:0:0 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 03:36:32.435535 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.virt.hardware [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 03:36:32.444079 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:32.444584 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:32.445016 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:32.445730 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:32.446182 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:32.447202 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:32.463199 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Getting quotas for project 708dee9f9959492990bf96006734070f. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 03:36:32.467044 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.quota [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Getting quotas for user 6bbd57e1a98644629c2602996cfe224e and project 708dee9f9959492990bf96006734070f. Resources: {'ram', 'cores', 'instances'} {{(pid=120383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 03:36:32.477493 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Going to run 1 instances... {{(pid=120383) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 03:36:32.479759 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='49d58309-5b6f-4b56-8999-a779f47b0a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 03:36:32.524625 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-d5c74d86-8408-46c0-b7a1-da6b04edcc32 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.415964 Sep 13 03:36:32.525442 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 666/1299] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 03:36:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 03:36:32.533865 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:32.535348 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:32.539455 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-6c9b8fc5-8d31-41c1-ae57-d63c1f58ea8a tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:32.540168 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-6c9b8fc5-8d31-41c1-ae57-d63c1f58ea8a tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:32.599775 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-6c9b8fc5-8d31-41c1-ae57-d63c1f58ea8a tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:32.606589 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-6c9b8fc5-8d31-41c1-ae57-d63c1f58ea8a tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1214 microversion: 2.1 time: 0.074319 Sep 13 03:36:32.607179 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 634/1300] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:32 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:33.629791 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-600963c4-6034-4dd2-881d-32de3407dd73 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:33.630408 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-600963c4-6034-4dd2-881d-32de3407dd73 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:33.639053 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-600963c4-6034-4dd2-881d-32de3407dd73 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:33.639576 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-600963c4-6034-4dd2-881d-32de3407dd73 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:33.639981 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-600963c4-6034-4dd2-881d-32de3407dd73 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:33.640686 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-600963c4-6034-4dd2-881d-32de3407dd73 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:33.641152 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-600963c4-6034-4dd2-881d-32de3407dd73 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:33.641584 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-600963c4-6034-4dd2-881d-32de3407dd73 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:33.718719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-600963c4-6034-4dd2-881d-32de3407dd73 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:33.726583 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-600963c4-6034-4dd2-881d-32de3407dd73 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1274 microversion: 2.1 time: 0.101098 Sep 13 03:36:33.727410 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 667/1301] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:33 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:36:34.748977 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5048ce1b-06c7-4b5b-97d7-9a056fb50b06 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:34.749586 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5048ce1b-06c7-4b5b-97d7-9a056fb50b06 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:34.756088 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5048ce1b-06c7-4b5b-97d7-9a056fb50b06 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:34.756575 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5048ce1b-06c7-4b5b-97d7-9a056fb50b06 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:34.757011 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5048ce1b-06c7-4b5b-97d7-9a056fb50b06 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:34.757700 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5048ce1b-06c7-4b5b-97d7-9a056fb50b06 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:34.758155 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5048ce1b-06c7-4b5b-97d7-9a056fb50b06 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:34.758576 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5048ce1b-06c7-4b5b-97d7-9a056fb50b06 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:34.894258 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5048ce1b-06c7-4b5b-97d7-9a056fb50b06 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:34.902450 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5048ce1b-06c7-4b5b-97d7-9a056fb50b06 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1314 microversion: 2.1 time: 0.157434 Sep 13 03:36:34.903059 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 635/1302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:34 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:35.268675 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-aabefebd-9871-4491-8342-9a32b3b30e2f req-de29dce8-9b3c-43db-863f-8f9ba63455a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9640134b-d44e-43c8-bf60-d6d3c12128c0", "tag": "0730b122-cc0f-445c-a8c7-83a9f32e9244"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:36:35.279399 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-aabefebd-9871-4491-8342-9a32b3b30e2f req-de29dce8-9b3c-43db-863f-8f9ba63455a7 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:35.279886 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-aabefebd-9871-4491-8342-9a32b3b30e2f req-de29dce8-9b3c-43db-863f-8f9ba63455a7 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:35.280319 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-aabefebd-9871-4491-8342-9a32b3b30e2f req-de29dce8-9b3c-43db-863f-8f9ba63455a7 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:35.291982 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-aabefebd-9871-4491-8342-9a32b3b30e2f req-de29dce8-9b3c-43db-863f-8f9ba63455a7 service nova] Creating event network-changed:0730b122-cc0f-445c-a8c7-83a9f32e9244 for instance 9640134b-d44e-43c8-bf60-d6d3c12128c0 on hv-cinder-85707 Sep 13 03:36:35.297173 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-aabefebd-9871-4491-8342-9a32b3b30e2f req-de29dce8-9b3c-43db-863f-8f9ba63455a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032161 Sep 13 03:36:35.297771 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 668/1303] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:36:35.926045 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-ad2bd0f8-8d56-4b96-8ab8-9556bfe1490b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:35.926686 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-ad2bd0f8-8d56-4b96-8ab8-9556bfe1490b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:35.933565 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad2bd0f8-8d56-4b96-8ab8-9556bfe1490b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:35.934045 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad2bd0f8-8d56-4b96-8ab8-9556bfe1490b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:35.934475 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad2bd0f8-8d56-4b96-8ab8-9556bfe1490b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:35.935183 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad2bd0f8-8d56-4b96-8ab8-9556bfe1490b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:35.935634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad2bd0f8-8d56-4b96-8ab8-9556bfe1490b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:35.936053 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-ad2bd0f8-8d56-4b96-8ab8-9556bfe1490b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:36.062251 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-ad2bd0f8-8d56-4b96-8ab8-9556bfe1490b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:36.070037 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-ad2bd0f8-8d56-4b96-8ab8-9556bfe1490b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1314 microversion: 2.1 time: 0.147762 Sep 13 03:36:36.070634 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 636/1304] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:35 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:36:37.093335 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-402fb8f3-2b6b-4386-b866-00a9bd9e859d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:37.094033 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-402fb8f3-2b6b-4386-b866-00a9bd9e859d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:37.100166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-402fb8f3-2b6b-4386-b866-00a9bd9e859d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:37.100680 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-402fb8f3-2b6b-4386-b866-00a9bd9e859d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:37.101140 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-402fb8f3-2b6b-4386-b866-00a9bd9e859d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:37.101827 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-402fb8f3-2b6b-4386-b866-00a9bd9e859d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:37.102281 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-402fb8f3-2b6b-4386-b866-00a9bd9e859d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:37.102739 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-402fb8f3-2b6b-4386-b866-00a9bd9e859d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:37.234700 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-402fb8f3-2b6b-4386-b866-00a9bd9e859d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:37.242288 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-402fb8f3-2b6b-4386-b866-00a9bd9e859d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1314 microversion: 2.1 time: 0.153648 Sep 13 03:36:37.242894 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 669/1305] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:37 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:38.265770 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-1ca4f24b-d458-4aa5-8a85-2712cdd431d0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:38.266383 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-1ca4f24b-d458-4aa5-8a85-2712cdd431d0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:38.272716 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ca4f24b-d458-4aa5-8a85-2712cdd431d0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:38.273203 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ca4f24b-d458-4aa5-8a85-2712cdd431d0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:38.273638 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ca4f24b-d458-4aa5-8a85-2712cdd431d0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:38.274324 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ca4f24b-d458-4aa5-8a85-2712cdd431d0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:38.275595 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ca4f24b-d458-4aa5-8a85-2712cdd431d0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:38.276020 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-1ca4f24b-d458-4aa5-8a85-2712cdd431d0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:38.406327 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-1ca4f24b-d458-4aa5-8a85-2712cdd431d0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:38.414629 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-1ca4f24b-d458-4aa5-8a85-2712cdd431d0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1314 microversion: 2.1 time: 0.152668 Sep 13 03:36:38.415225 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 637/1306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:38 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:39.436768 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-6e436aab-a951-4547-b148-d18d9c8e536d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:39.437382 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-6e436aab-a951-4547-b148-d18d9c8e536d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:39.441059 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 03:36:39.441337 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: Tue Sep 13 03:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 (ip 10.222.0.18) !!! Sep 13 03:36:39.446264 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6e436aab-a951-4547-b148-d18d9c8e536d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:39.446769 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6e436aab-a951-4547-b148-d18d9c8e536d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:39.447202 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6e436aab-a951-4547-b148-d18d9c8e536d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:39.447887 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6e436aab-a951-4547-b148-d18d9c8e536d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:39.448338 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6e436aab-a951-4547-b148-d18d9c8e536d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:39.448756 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-6e436aab-a951-4547-b148-d18d9c8e536d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:39.575089 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-6e436aab-a951-4547-b148-d18d9c8e536d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:39.582746 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-6e436aab-a951-4547-b148-d18d9c8e536d tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1314 microversion: 2.1 time: 0.149761 Sep 13 03:36:39.583316 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 670/1307] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:39 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:40.605891 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-5f5c6cd6-734e-4049-ab56-de0c2b7b02f2 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:40.606484 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-5f5c6cd6-734e-4049-ab56-de0c2b7b02f2 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:40.613428 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f5c6cd6-734e-4049-ab56-de0c2b7b02f2 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:40.613913 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f5c6cd6-734e-4049-ab56-de0c2b7b02f2 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:40.614349 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f5c6cd6-734e-4049-ab56-de0c2b7b02f2 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:40.615078 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f5c6cd6-734e-4049-ab56-de0c2b7b02f2 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:40.615536 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f5c6cd6-734e-4049-ab56-de0c2b7b02f2 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:40.615958 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-5f5c6cd6-734e-4049-ab56-de0c2b7b02f2 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:40.739616 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-5f5c6cd6-734e-4049-ab56-de0c2b7b02f2 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:40.747043 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-5f5c6cd6-734e-4049-ab56-de0c2b7b02f2 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1314 microversion: 2.1 time: 0.145608 Sep 13 03:36:40.747601 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 638/1308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:40 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:41.710123 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [req-a46e4b04-c744-4ef9-a816-b31f1335dd60 req-26e640af-a050-4f8e-b5d6-b0a7e7659171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9640134b-d44e-43c8-bf60-d6d3c12128c0", "name": "network-vif-plugged", "status": "completed", "tag": "0730b122-cc0f-445c-a8c7-83a9f32e9244"}]} {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:36:41.720640 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-a46e4b04-c744-4ef9-a816-b31f1335dd60 req-26e640af-a050-4f8e-b5d6-b0a7e7659171 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:41.721143 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-a46e4b04-c744-4ef9-a816-b31f1335dd60 req-26e640af-a050-4f8e-b5d6-b0a7e7659171 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:41.721571 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [req-a46e4b04-c744-4ef9-a816-b31f1335dd60 req-26e640af-a050-4f8e-b5d6-b0a7e7659171 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:41.733206 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.compute.server_external_events [req-a46e4b04-c744-4ef9-a816-b31f1335dd60 req-26e640af-a050-4f8e-b5d6-b0a7e7659171 service nova] Creating event network-vif-plugged:0730b122-cc0f-445c-a8c7-83a9f32e9244 for instance 9640134b-d44e-43c8-bf60-d6d3c12128c0 on hv-cinder-85707 Sep 13 03:36:41.737918 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [req-a46e4b04-c744-4ef9-a816-b31f1335dd60 req-26e640af-a050-4f8e-b5d6-b0a7e7659171 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031463 Sep 13 03:36:41.738537 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 671/1309] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:36:41.769545 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-2dcd97f4-5297-4710-8414-e7b7b7c0b79f tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:41.770149 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-2dcd97f4-5297-4710-8414-e7b7b7c0b79f tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:41.777464 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2dcd97f4-5297-4710-8414-e7b7b7c0b79f tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:41.778021 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2dcd97f4-5297-4710-8414-e7b7b7c0b79f tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:41.778396 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2dcd97f4-5297-4710-8414-e7b7b7c0b79f tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:41.779147 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2dcd97f4-5297-4710-8414-e7b7b7c0b79f tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:41.779601 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2dcd97f4-5297-4710-8414-e7b7b7c0b79f tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:41.780036 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-2dcd97f4-5297-4710-8414-e7b7b7c0b79f tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:41.913276 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-2dcd97f4-5297-4710-8414-e7b7b7c0b79f tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:41.921520 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-2dcd97f4-5297-4710-8414-e7b7b7c0b79f tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1314 microversion: 2.1 time: 0.155908 Sep 13 03:36:41.922093 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 639/1310] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:41 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:42.941429 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=2 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:42.942221 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG dbcounter [-] [120383] Writing DB stats nova_cell0:SELECT=6 {{(pid=120383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:42.946801 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-54810b90-cac7-4ee8-a7d8-6f893d5b9997 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:42.947507 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-54810b90-cac7-4ee8-a7d8-6f893d5b9997 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:42.954566 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54810b90-cac7-4ee8-a7d8-6f893d5b9997 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:42.955078 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54810b90-cac7-4ee8-a7d8-6f893d5b9997 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:42.955516 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54810b90-cac7-4ee8-a7d8-6f893d5b9997 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:42.956204 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54810b90-cac7-4ee8-a7d8-6f893d5b9997 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:42.956664 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54810b90-cac7-4ee8-a7d8-6f893d5b9997 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:42.957092 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-54810b90-cac7-4ee8-a7d8-6f893d5b9997 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:43.088522 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-54810b90-cac7-4ee8-a7d8-6f893d5b9997 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:43.096519 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-54810b90-cac7-4ee8-a7d8-6f893d5b9997 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1314 microversion: 2.1 time: 0.156062 Sep 13 03:36:43.097065 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 672/1311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:42 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:44.119604 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-fe21b221-8384-4094-82e7-6601c08f60f0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:44.120720 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-fe21b221-8384-4094-82e7-6601c08f60f0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:44.122593 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG dbcounter [-] [120384] Writing DB stats nova_cell0:SELECT=2 {{(pid=120384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:44.128535 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fe21b221-8384-4094-82e7-6601c08f60f0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:44.129025 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fe21b221-8384-4094-82e7-6601c08f60f0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:44.129468 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fe21b221-8384-4094-82e7-6601c08f60f0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:44.130165 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fe21b221-8384-4094-82e7-6601c08f60f0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:44.130640 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fe21b221-8384-4094-82e7-6601c08f60f0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:44.131071 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-fe21b221-8384-4094-82e7-6601c08f60f0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:44.262747 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-fe21b221-8384-4094-82e7-6601c08f60f0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:44.270472 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-fe21b221-8384-4094-82e7-6601c08f60f0 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1464 microversion: 2.1 time: 0.154809 Sep 13 03:36:44.271063 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 640/1312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:44 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:44.316811 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-25a54ead-61cc-4983-8b81-897e53b02348 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:44.317285 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-25a54ead-61cc-4983-8b81-897e53b02348 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:44.324123 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-25a54ead-61cc-4983-8b81-897e53b02348 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:44.324607 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-25a54ead-61cc-4983-8b81-897e53b02348 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:44.325041 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-25a54ead-61cc-4983-8b81-897e53b02348 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:44.325719 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-25a54ead-61cc-4983-8b81-897e53b02348 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:44.326166 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-25a54ead-61cc-4983-8b81-897e53b02348 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:44.326586 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-25a54ead-61cc-4983-8b81-897e53b02348 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:44.350542 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-25a54ead-61cc-4983-8b81-897e53b02348 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Going to try to terminate instance {{(pid=120383) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 03:36:44.423428 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-25a54ead-61cc-4983-8b81-897e53b02348 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 204 len: 0 microversion: 2.1 time: 0.110049 Sep 13 03:36:44.424116 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 673/1313] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 03:36:44 2022] DELETE /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 03:36:44.432211 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-c1cfb279-2b9e-4eef-9446-79a561c9cd9b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:44.433366 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-c1cfb279-2b9e-4eef-9446-79a561c9cd9b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:44.439188 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c1cfb279-2b9e-4eef-9446-79a561c9cd9b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:44.439666 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c1cfb279-2b9e-4eef-9446-79a561c9cd9b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:44.440094 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c1cfb279-2b9e-4eef-9446-79a561c9cd9b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:44.440770 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c1cfb279-2b9e-4eef-9446-79a561c9cd9b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:44.441218 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c1cfb279-2b9e-4eef-9446-79a561c9cd9b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:44.441633 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-c1cfb279-2b9e-4eef-9446-79a561c9cd9b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:44.565656 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.policy [None req-c1cfb279-2b9e-4eef-9446-79a561c9cd9b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:44.573154 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-c1cfb279-2b9e-4eef-9446-79a561c9cd9b tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1470 microversion: 2.1 time: 0.144860 Sep 13 03:36:44.574336 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 641/1314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:44 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 03:36:45.597408 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-86b757d2-1d6a-462c-8ed0-b221c19de902 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:45.598138 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-86b757d2-1d6a-462c-8ed0-b221c19de902 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:45.604494 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-86b757d2-1d6a-462c-8ed0-b221c19de902 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:45.604976 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-86b757d2-1d6a-462c-8ed0-b221c19de902 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:45.605417 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-86b757d2-1d6a-462c-8ed0-b221c19de902 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:45.606102 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-86b757d2-1d6a-462c-8ed0-b221c19de902 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:45.606560 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-86b757d2-1d6a-462c-8ed0-b221c19de902 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:45.607025 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-86b757d2-1d6a-462c-8ed0-b221c19de902 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:45.736179 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-86b757d2-1d6a-462c-8ed0-b221c19de902 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:45.744013 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-86b757d2-1d6a-462c-8ed0-b221c19de902 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1470 microversion: 2.1 time: 0.150807 Sep 13 03:36:45.744582 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 674/1315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:45 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:46.628567 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [req-621e5627-ba1b-49d3-8347-f8ebc78ac695 req-4f4ddd52-576b-49da-980c-d684e43113b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9640134b-d44e-43c8-bf60-d6d3c12128c0", "name": "network-vif-deleted", "tag": "0730b122-cc0f-445c-a8c7-83a9f32e9244"}]} {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 03:36:46.642144 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-621e5627-ba1b-49d3-8347-f8ebc78ac695 req-4f4ddd52-576b-49da-980c-d684e43113b3 service nova] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:46.642660 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-621e5627-ba1b-49d3-8347-f8ebc78ac695 req-4f4ddd52-576b-49da-980c-d684e43113b3 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:46.643187 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [req-621e5627-ba1b-49d3-8347-f8ebc78ac695 req-4f4ddd52-576b-49da-980c-d684e43113b3 service nova] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:46.659569 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.compute.server_external_events [req-621e5627-ba1b-49d3-8347-f8ebc78ac695 req-4f4ddd52-576b-49da-980c-d684e43113b3 service nova] Creating event network-vif-deleted:0730b122-cc0f-445c-a8c7-83a9f32e9244 for instance 9640134b-d44e-43c8-bf60-d6d3c12128c0 on hv-cinder-85707 Sep 13 03:36:46.664670 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [req-621e5627-ba1b-49d3-8347-f8ebc78ac695 req-4f4ddd52-576b-49da-980c-d684e43113b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040860 Sep 13 03:36:46.665276 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 642/1316] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 03:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 03:36:46.769387 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.api.openstack.wsgi [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:46.770003 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.compute.api [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120383) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:46.777270 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:46.777754 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:46.778198 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:46.778926 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:46.779389 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:46.779814 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:46.813117 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:46.813593 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:46.814021 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG oslo_concurrency.lockutils [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:46.814462 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.objects.instance [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lazy-loading 'fault' on Instance uuid 9640134b-d44e-43c8-bf60-d6d3c12128c0 {{(pid=120383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 03:36:46.856101 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: DEBUG nova.policy [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bbd57e1a98644629c2602996cfe224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708dee9f9959492990bf96006734070f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120383) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 03:36:46.863712 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: INFO nova.api.openstack.requestlog [None req-b018079f-1168-41db-8811-d37471a829fb tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 200 len: 1304 microversion: 2.1 time: 0.098845 Sep 13 03:36:46.864276 dv-cinder-857075-2-iscsi devstack@n-api.service[120383]: [pid: 120383|app: 0|req: 675/1317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:46 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 03:36:47.887421 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a7742b1b-2840-40fc-98cf-ba7b52cb0087 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Calling method '>' {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 03:36:47.888042 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.compute.api [None req-a7742b1b-2840-40fc-98cf-ba7b52cb0087 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] [instance: 9640134b-d44e-43c8-bf60-d6d3c12128c0] Fetching instance by UUID {{(pid=120384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 03:36:47.894557 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a7742b1b-2840-40fc-98cf-ba7b52cb0087 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:47.895062 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a7742b1b-2840-40fc-98cf-ba7b52cb0087 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:47.895493 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a7742b1b-2840-40fc-98cf-ba7b52cb0087 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:47.896172 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a7742b1b-2840-40fc-98cf-ba7b52cb0087 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Acquiring lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 03:36:47.896622 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a7742b1b-2840-40fc-98cf-ba7b52cb0087 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 03:36:47.897038 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG oslo_concurrency.lockutils [None req-a7742b1b-2840-40fc-98cf-ba7b52cb0087 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Lock "8232eabc-875a-4f0b-84ce-ecae7315d84c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 03:36:47.910673 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.wsgi [None req-a7742b1b-2840-40fc-98cf-ba7b52cb0087 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] HTTP exception thrown: Instance 9640134b-d44e-43c8-bf60-d6d3c12128c0 could not be found. Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a7742b1b-2840-40fc-98cf-ba7b52cb0087 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Request method failure captured: Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: request: GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 HTTP/1.1 Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept: application/json Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Accept-Encoding: identity Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Connection: close Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Length: 0 Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Content-Type: application/json Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Host: 10.222.0.18 Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: Openstack-System-Scope: None Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: User-Agent: python-urllib3/1.26.12 Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Auth-Token: gAAAAABjH_q-RioUguxm2ZMvIPG7KBZnsSBnAWCCyHxKgGQZif4mWGhfvTo24_1oGdCSEpvw3o6AVDXbd-eTQJ3aTIUOghmbfl6x7uHhH6BpUKtcCmC4jMcih86r8apY0NJ2yKMNfHnqq_3aJgcooM-l0izD-fQ8SLfwACc3k5_-OQkt4kp5Z0U Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Id: None Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Domain-Name: None Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Identity-Status: Confirmed Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Is-Admin-Project: True Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Id: default Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Domain-Name: Default Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Id: 708dee9f9959492990bf96006734070f Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Project-Name: tempest-VolumesNegativeTest-1469924746 Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Role: reader,member Sep 13 03:36:47.912255 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Roles: reader,member Sep 13 03:36:47.913908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/708dee9f9959492990bf96006734070f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_708dee9f9959492990bf96006734070f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/708dee9f9959492990bf96006734070f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/708dee9f9959492990bf96006734070f"}]}] Sep 13 03:36:47.913908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant: tempest-VolumesNegativeTest-1469924746 Sep 13 03:36:47.913908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Id: 708dee9f9959492990bf96006734070f Sep 13 03:36:47.913908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-Tenant-Name: tempest-VolumesNegativeTest-1469924746 Sep 13 03:36:47.913908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User: tempest-VolumesNegativeTest-1469924746-project Sep 13 03:36:47.913908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Id: default Sep 13 03:36:47.913908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Domain-Name: Default Sep 13 03:36:47.913908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Id: 6bbd57e1a98644629c2602996cfe224e Sep 13 03:36:47.913908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: X-User-Name: tempest-VolumesNegativeTest-1469924746-project Sep 13 03:36:47.913908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: method: > Sep 13 03:36:47.913908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: exception: Instance 9640134b-d44e-43c8-bf60-d6d3c12128c0 could not be found. Sep 13 03:36:47.913908 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: action_args: {'id': '9640134b-d44e-43c8-bf60-d6d3c12128c0'} Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: {{(pid=120384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9640134b-d44e-43c8-bf60-d6d3c12128c0 could not be found. Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 03:36:47.914986 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9640134b-d44e-43c8-bf60-d6d3c12128c0 could not be found. Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9640134b-d44e-43c8-bf60-d6d3c12128c0 could not be found. Sep 13 03:36:47.916779 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: ERROR nova.api.openstack.wsgi Sep 13 03:36:47.918541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: DEBUG nova.api.openstack.wsgi [None req-a7742b1b-2840-40fc-98cf-ba7b52cb0087 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] Returning 404 to user: Instance 9640134b-d44e-43c8-bf60-d6d3c12128c0 could not be found. {{(pid=120384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 03:36:47.918541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: INFO nova.api.openstack.requestlog [None req-a7742b1b-2840-40fc-98cf-ba7b52cb0087 tempest-VolumesNegativeTest-1469924746 tempest-VolumesNegativeTest-1469924746-project] 10.222.0.18 "GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0" status: 404 len: 111 microversion: 2.1 time: 0.031073 Sep 13 03:36:47.918541 dv-cinder-857075-2-iscsi devstack@n-api.service[120384]: [pid: 120384|app: 0|req: 643/1318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 03:36:47 2022] GET /compute/v2.1/servers/9640134b-d44e-43c8-bf60-d6d3c12128c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)